[ 510.152612] env[62909]: INFO neutron.common.config [-] Logging enabled! [ 510.153050] env[62909]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev13 [ 510.153149] env[62909]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62909) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} [ 510.153404] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 510.153505] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 510.154388] env[62909]: WARNING oslo_policy.policy [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 510.154610] env[62909]: WARNING oslo_policy.policy [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 510.156178] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] VMware NSXv3 Agent initialized successfully. [ 510.156548] env[62909]: DEBUG oslo_concurrency.lockutils [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] Acquiring lock "singleton_lock" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 510.156687] env[62909]: DEBUG oslo_concurrency.lockutils [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] Acquired lock "singleton_lock" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.156936] env[62909]: DEBUG oslo_concurrency.lockutils [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] Releasing lock "singleton_lock" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 510.157252] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] Full set of CONF: {{(pid=62909) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} [ 510.157372] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ******************************************************************************** {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 510.157481] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] Configuration options gathered from: {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 510.157856] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2808}} [ 510.158114] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 510.158204] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ================================================================================ {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2811}} [ 510.158313] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] agent_down_time = 75 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.158457] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] allow_automatic_dhcp_failover = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.158599] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] allow_bulk = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.158746] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] api_extensions_path = {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.158888] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] api_paste_config = api-paste.ini {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.159044] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] auth_strategy = keystone {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.159185] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] backdoor_port = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.159276] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] backdoor_socket = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.159421] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] backlog = 4096 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.159565] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] base_mac = fa:16:3e:00:00:00 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.159712] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] bind_host = 0.0.0.0 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.159859] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] bind_port = 9696 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.160010] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] client_socket_timeout = 900 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.160161] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] config_dir = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.160273] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.160414] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] config_source = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.160557] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] control_exchange = neutron {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.160699] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] core_plugin = ml2 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.160843] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] debug = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.161561] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] default_availability_zones = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.161817] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.161977] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] dhcp_agent_notification = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.162140] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] dhcp_agents_per_network = 1 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.162321] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] dhcp_lease_duration = 86400 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.162493] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] dhcp_load_type = networks {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.162643] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] dns_domain = openstacklocal {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.162788] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.162929] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] enable_default_route_bfd = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.163078] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] enable_default_route_ecmp = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.163227] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] enable_dvr = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.163355] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] enable_new_agents = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.163491] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.163626] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] enable_signals = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.163761] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] enable_traditional_dhcp = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.163893] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] external_dns_driver = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.164040] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] filter_validation = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.164196] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] global_physnet_mtu = 8950 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.164330] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] graceful_shutdown_timeout = 60 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.164505] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] host = cpu-1 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.164644] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] host_dvr_for_dhcp = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.164818] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] http_retries = 3 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.164962] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] instance_format = [instance: %(uuid)s] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.165118] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.165262] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ipam_driver = internal {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.165400] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ipv6_pd_enabled = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.165535] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] l3_ha = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.165675] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.165813] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] l3_ha_network_physical_name = {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.165954] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] l3_ha_network_type = {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.166107] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] log_color = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.166251] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] log_config_append = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.166391] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.166525] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] log_dir = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.166660] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] log_file = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.166768] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] log_options = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.166938] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] log_rotate_interval = 1 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.167102] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] log_rotate_interval_type = days {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.167245] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] log_rotation_type = none {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.167355] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.167463] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.167603] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.167744] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.167853] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.168022] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] max_dns_nameservers = 5 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.168168] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] max_header_line = 16384 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.168308] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] max_l3_agents_per_router = 3 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.168443] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] max_logfile_count = 30 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.168578] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] max_logfile_size_mb = 200 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.168712] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] max_subnet_host_routes = 20 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.168854] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] my_ip = 10.180.1.21 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.168993] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] my_ipv6 = ::1 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.169152] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] network_auto_schedule = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.169285] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] network_link_prefix = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.169425] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.169566] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] notify_nova_on_port_data_changes = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.169704] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] notify_nova_on_port_status_changes = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.169843] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] pagination_max_limit = -1 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.169980] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] publish_errors = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.170190] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] rate_limit_burst = 0 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.170360] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] rate_limit_except_level = CRITICAL {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.170499] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] rate_limit_interval = 0 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.170636] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] retry_until_window = 30 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.170771] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] router_distributed = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.170911] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] rpc_resources_processing_step = 20 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.171055] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] rpc_response_max_timeout = 600 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.171195] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] rpc_response_timeout = 60 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.171331] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] send_events_interval = 2 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.171484] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] service_plugins = ['router'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.171627] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] setproctitle = on {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.171760] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] shell_completion = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.171900] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] state_path = /opt/stack/data/neutron {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.172054] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] syslog_log_facility = LOG_USER {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.172195] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] tcp_keepidle = 600 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.172335] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] transport_url = **** {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.172471] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] use_eventlog = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.172606] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] use_journal = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.172738] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] use_json = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.172873] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] use_ssl = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.173013] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] use_stderr = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.173161] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] use_syslog = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.173302] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] vlan_transparent = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.173438] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] watch_log_file = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.173577] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] wsgi_default_pool_size = 100 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.173716] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] wsgi_keep_alive = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.173859] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.173996] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] wsgi_server_debug = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 510.174161] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_concurrency.disable_process_locking = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.174309] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.174458] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.174598] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.174768] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.174929] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.175084] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.175240] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.connection_string = messaging:// {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.175385] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.enabled = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.175531] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.es_doc_type = notification {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.175673] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.es_scroll_size = 10000 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.175818] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.es_scroll_time = 2m {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.175959] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.filter_error_trace = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.176116] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.hmac_keys = **** {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.176265] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.sentinel_service_name = mymaster {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.176415] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.socket_timeout = 0.1 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.176556] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.trace_requests = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.176696] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler.trace_sqlalchemy = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.176895] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler_jaeger.process_tags = {} {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.177056] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler_jaeger.service_name_prefix = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.177201] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] profiler_otlp.service_name_prefix = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.177354] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_policy.enforce_new_defaults = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.177634] env[62909]: WARNING oslo_config.cfg [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 510.177803] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_policy.enforce_scope = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.177949] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_policy.policy_default_rule = default {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.178121] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.178272] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.178419] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.178557] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.178695] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.178830] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.178970] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.179131] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.179282] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] agent.extensions = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.179429] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.179575] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] service_providers.service_provider = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.179724] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.default_quota = -1 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.179894] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.180018] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.quota_floatingip = 50 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.180161] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.quota_network = 100 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.180306] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.quota_port = 500 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.180437] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.180574] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.quota_router = 10 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.180713] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.quota_security_group = 10 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.180853] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.180996] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.quota_subnet = 100 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.181142] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] QUOTAS.track_quota_usage = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.181294] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.181432] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep.group = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.181566] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep.helper_command = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.181706] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.181844] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep.thread_pool_size = 8 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.181983] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep.user = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.182143] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.182278] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_dhcp_release.group = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.182412] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_dhcp_release.helper_command = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.182552] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.182694] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.182832] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_dhcp_release.user = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.182979] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.183124] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_ovs_vsctl.group = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.183259] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_ovs_vsctl.helper_command = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.183401] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.183540] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.183672] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_ovs_vsctl.user = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.183815] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_namespace.capabilities = [21] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.183950] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_namespace.group = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.184096] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_namespace.helper_command = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.184242] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.184384] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_namespace.thread_pool_size = 8 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.184517] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_namespace.user = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.184663] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_conntrack.capabilities = [12] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.184822] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_conntrack.group = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.184965] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_conntrack.helper_command = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.185120] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.185262] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.185397] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_conntrack.user = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.185543] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_link.capabilities = [12, 21] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.185678] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_link.group = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.185811] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_link.helper_command = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.185951] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.186101] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_link.thread_pool_size = 8 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.186235] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] privsep_link.user = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.186388] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.186534] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.186675] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.continue_on_failed_promotions = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.186824] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.dscp = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.186984] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.dscp_inherit = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.187148] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.force_mp_to_policy = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.187290] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.locking_coordinator_url = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.187432] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.log_agent_heartbeats = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.187573] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.logging_expire = 1 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.187718] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.187860] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.188017] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.polling_interval = 240 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.188161] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.188308] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.188454] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.report_interval = 30.0 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.188599] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.188741] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.188885] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.189035] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.sync_skew = 60 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.189179] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.synchronization_queue_size = 20 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.189319] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT.use_helper_for_ns_read = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.189468] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] SECURITYGROUP.enable_ipset = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.189612] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] SECURITYGROUP.enable_security_group = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.189754] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.189900] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.190058] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] experimental.ipv6_pd_enabled = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.190206] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] experimental.linuxbridge = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.190366] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ml2.extension_drivers = ['port_security'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.190505] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ml2.external_network_type = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.190663] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.190809] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ml2.overlay_ip_version = 4 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.190957] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ml2.path_mtu = 8950 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.191114] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ml2.physical_network_mtus = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.191264] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ml2.tenant_network_types = ['vlan'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.191409] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.191556] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ml2.type_drivers = ['vlan'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.191706] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT_CLI.neutron_port_id = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.191847] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.191989] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.192155] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.192305] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.192450] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.192594] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.192738] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.192923] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.193149] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.193300] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_login_password = **** {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.193450] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_login_port = 443 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.193596] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_login_user = admin {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.193744] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.193894] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.194050] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.194198] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.194348] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.194500] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.194648] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.194824] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.194985] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.195150] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.195308] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.195450] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.195596] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.195791] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.195941] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] vsphere.vsphere_login_password = VMware1! {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.196100] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.196246] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.196395] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.auth_section = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.196552] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.auth_type = password {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.196697] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.196867] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.certfile = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.197072] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.collect_timing = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.197260] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.endpoint_type = public {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.197408] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.insecure = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.197548] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.keyfile = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.197701] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.region_name = RegionOne {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.197846] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.split_loggers = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.197988] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] nova.timeout = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.198151] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.auth_section = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.198302] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.auth_type = password {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.198448] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.198588] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.certfile = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.198729] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.collect_timing = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.198875] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.endpoint_type = public {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.199024] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.insecure = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.199165] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.keyfile = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.199299] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.region_name = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.199440] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.split_loggers = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.199575] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] placement.timeout = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.199722] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.auth_section = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.199863] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.auth_type = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.200009] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.cafile = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.200150] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.certfile = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.200291] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.collect_timing = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.200426] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.connect_retries = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.200563] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.connect_retry_delay = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.200703] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.enable_notifications = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.200839] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.endpoint_override = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.200985] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.insecure = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.201134] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.interface = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.201270] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.keyfile = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.201407] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.max_version = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.201545] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.min_version = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.201682] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.region_name = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.201820] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.retriable_status_codes = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.201959] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.service_name = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.202112] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.service_type = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.202258] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.split_loggers = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.202397] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.status_code_retries = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.202531] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.status_code_retry_delay = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.202664] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.timeout = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.202800] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.valid_interfaces = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.202937] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ironic.version = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.203092] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] cli_script.dry_run = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.203251] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.203393] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.203535] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.203677] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.203821] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.203967] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.204116] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.204257] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.204398] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.204548] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.204692] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.204895] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.205071] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.205227] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.205380] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.205525] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.205667] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.205820] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.205964] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.206120] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.206266] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.206411] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.206553] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.206699] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.206874] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.207032] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.207180] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.207326] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.207476] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.207621] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.ssl = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.207779] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.207930] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.208084] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.208237] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.208386] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.208527] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.208687] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_notifications.driver = [] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.208833] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_notifications.retry = -1 {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.209014] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.209181] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 510.209288] env[62909]: DEBUG oslo_service.service [None req-69282084-43a9-4d5f-a927-15cbe5a27aa8 None None] ******************************************************************************** {{(pid=62909) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2830}} [ 510.210373] env[62909]: DEBUG neutron.agent.securitygroups_rpc [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Init firewall settings (driver=nsxv3) {{(pid=62909) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:124}} [ 510.211710] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=62909) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 510.211932] env[62909]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] RPC agent_id: nsxm-l-01a.corp.local [ 510.214088] env[62909]: DEBUG dogpile.cache.region [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 510.214211] env[62909]: DEBUG dogpile.lock [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 510.214311] env[62909]: DEBUG dogpile.lock [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 510.214406] env[62909]: DEBUG dogpile.lock [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 510.214502] env[62909]: DEBUG dogpile.cache.region [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 510.214592] env[62909]: DEBUG dogpile.lock [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 510.214736] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 510.403973] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Session token - acquiring [ 510.405895] env[62909]: DEBUG networking_nsxv3.common.locking [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.406098] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 510.406212] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.406614] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 510.418130] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 510.685917] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 510.711110] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 510.711311] env[62909]: DEBUG dogpile.cache.region [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Cache value generated in 0.497 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 510.711384] env[62909]: DEBUG dogpile.lock [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 510.711506] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Activating Policy API Provider. [ 510.711707] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Looking for the default Infrastructure Rules. [ 510.783021] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Looking for the Default Layer3 Logged Drop Section. [ 510.798085] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 510.798545] env[62909]: DEBUG networking_nsxv3.common.locking [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.798713] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquiring lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 510.798818] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.799130] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired external semaphore "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 510.799454] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 511.315411] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 511.817754] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 512.320421] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Inventory metadata is going to be refreshed. [ 512.320918] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 513.103937] env[62909]: DEBUG networking_nsxv3.common.locking [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.104204] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 513.104255] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.104555] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 513.116793] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 513.117795] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 513.118477] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 513.136625] env[62909]: DEBUG networking_nsxv3.common.locking [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.136861] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 513.137047] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.137404] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 513.137541] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 513.137701] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 513.137844] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 513.138014] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 513.157303] env[62909]: DEBUG networking_nsxv3.common.locking [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.157524] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 513.157578] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.157876] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 513.158121] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 513.158280] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 513.177412] env[62909]: DEBUG networking_nsxv3.common.locking [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.177638] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 513.177679] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.178015] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 513.178172] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 513.178321] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 513.198301] env[62909]: DEBUG networking_nsxv3.common.locking [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.198500] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquiring lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 513.198717] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.199095] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired external semaphore "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 513.199231] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Releasing lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 513.199388] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 513.199496] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 513.199602] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 513.218206] env[62909]: DEBUG networking_nsxv3.common.locking [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.218475] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquiring lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 513.218559] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.218823] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired external semaphore "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 513.218954] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Releasing lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 513.219118] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 513.219230] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 513.219335] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 513.244012] env[62909]: DEBUG networking_nsxv3.common.locking [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.244265] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 513.244326] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.244768] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 513.244962] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 513.245152] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 513.245264] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 513.245372] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Inventory metadata have been refreshed. [ 513.245479] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Dryrun:True. Metadata refresh completed. [ 513.245604] env[62909]: DEBUG oslo_concurrency.lockutils [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Releasing lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 513.247241] env[62909]: INFO neutron.agent.agent_extensions_manager [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Loaded agent extensions: [] [ 513.248014] env[62909]: DEBUG neutron_lib.callbacks.manager [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=62909) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 513.297336] env[62909]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] NSXv3 Agent Agent RPC Daemon Started! [ 513.297524] env[62909]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] NSXv3 Agent Agent loop - iteration:0 started [ 513.297662] env[62909]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] NSXv3 Agent Agent out of sync with plugin! [ 518.248078] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 518.248434] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 523.249084] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 523.249350] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 526.746970] env[62909]: INFO networking_nsxv3.common.synchronization [None req-5997082b-6360-40d5-8306-7ca44f77c470 demo admin] Enqueued Resource ID: e2a321f5-ac95-4df9-9bcd-40ab6d2be16a with Priority: HIGHEST for action security_group_rules [ 526.747543] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2a321f5-ac95-4df9-9bcd-40ab6d2be16a with Priority: HIGHEST for action security_group_rules [ 526.747839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2a321f5-ac95-4df9-9bcd-40ab6d2be16a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.747965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2a321f5-ac95-4df9-9bcd-40ab6d2be16a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 526.748044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2a321f5-ac95-4df9-9bcd-40ab6d2be16a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.748399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2a321f5-ac95-4df9-9bcd-40ab6d2be16a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 526.748485] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2a321f5-ac95-4df9-9bcd-40ab6d2be16a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.269608] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.269837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 527.269837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.269997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 527.270101] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 527.270198] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2a321f5-ac95-4df9-9bcd-40ab6d2be16a already deleted. [ 527.270278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2a321f5-ac95-4df9-9bcd-40ab6d2be16a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 531.748944] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 531.749541] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 536.750910] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 536.750910] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 541.752061] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 541.752061] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 546.753162] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.753700] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 547.250781] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.251073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.251073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.252314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.252314] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.759872] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.262703] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.764057] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 548.764632] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 549.555018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.555018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.555018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.555018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.570131] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 549.572589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.572589] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 549.598433] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.598433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.598433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.598433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.598433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.598433] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 549.598433] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.598433] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 549.621581] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.621968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.622461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.622817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.623092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.623330] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 549.645352] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.645822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.646036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.646372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.646617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.646849] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 549.666473] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.666924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.667140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.667482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.667735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.667980] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 549.668201] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.668384] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 549.686359] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.687930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.688083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.688343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.688486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.688649] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 549.688821] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.688943] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 549.710975] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.711168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.711213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.711424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.711530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.711593] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 549.711653] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.711703] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 549.711763] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 549.711834] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 549.711894] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 549.711953] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 549.712346] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 549.712346] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 549.712346] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 549.740755] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.740755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.740755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.740755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.741146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.741146] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 549.762302] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.762476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.762515] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.763981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.763981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.796082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.754479] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.754797] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 554.835135] env[62909]: INFO networking_nsxv3.common.synchronization [None req-3639a388-9d63-47e5-b788-e5cd7fc1b8e6 None None] Enqueued Resource ID: ed1ec4c1-304d-4436-9da5-dad2e8c6fb01 with Priority: HIGHEST for action port [ 554.835135] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed1ec4c1-304d-4436-9da5-dad2e8c6fb01 with Priority: HIGHEST for action port [ 554.835135] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed1ec4c1-304d-4436-9da5-dad2e8c6fb01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.835135] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed1ec4c1-304d-4436-9da5-dad2e8c6fb01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 554.835135] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed1ec4c1-304d-4436-9da5-dad2e8c6fb01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.835135] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed1ec4c1-304d-4436-9da5-dad2e8c6fb01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 554.835948] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed1ec4c1-304d-4436-9da5-dad2e8c6fb01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.338936] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed1ec4c1-304d-4436-9da5-dad2e8c6fb01 [ 555.339195] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.339335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.339442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.339621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.339779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.339845] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed1ec4c1-304d-4436-9da5-dad2e8c6fb01 already deleted. [ 555.339900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed1ec4c1-304d-4436-9da5-dad2e8c6fb01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 557.462423] env[62909]: INFO networking_nsxv3.common.synchronization [None req-03990fba-0035-4e2a-a1db-f1eb0d791a0e None None] Enqueued Resource ID: 339d4bef-b341-46a9-812c-6ba4b34b5a28 with Priority: HIGHEST for action port [ 557.462866] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339d4bef-b341-46a9-812c-6ba4b34b5a28 with Priority: HIGHEST for action port [ 557.463277] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-339d4bef-b341-46a9-812c-6ba4b34b5a28 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.463413] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-339d4bef-b341-46a9-812c-6ba4b34b5a28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 557.463758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-339d4bef-b341-46a9-812c-6ba4b34b5a28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.463758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-339d4bef-b341-46a9-812c-6ba4b34b5a28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 557.463896] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('339d4bef-b341-46a9-812c-6ba4b34b5a28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.966330] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 339d4bef-b341-46a9-812c-6ba4b34b5a28 [ 557.966446] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.966575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 557.968086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.968086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 557.968086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 557.968086] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:339d4bef-b341-46a9-812c-6ba4b34b5a28 already deleted. [ 557.968086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-339d4bef-b341-46a9-812c-6ba4b34b5a28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.200858] env[62909]: INFO networking_nsxv3.common.synchronization [None req-fd236b02-073f-4daa-bb2b-d65a5a01f318 None None] Enqueued Resource ID: 350c1d59-c288-4a60-872e-cc51c2f13eb2 with Priority: HIGHEST for action port [ 558.202348] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350c1d59-c288-4a60-872e-cc51c2f13eb2 with Priority: HIGHEST for action port [ 558.203121] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-350c1d59-c288-4a60-872e-cc51c2f13eb2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.205197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-350c1d59-c288-4a60-872e-cc51c2f13eb2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.205197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-350c1d59-c288-4a60-872e-cc51c2f13eb2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.205197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-350c1d59-c288-4a60-872e-cc51c2f13eb2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.205197] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('350c1d59-c288-4a60-872e-cc51c2f13eb2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.708239] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 350c1d59-c288-4a60-872e-cc51c2f13eb2 [ 558.708239] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.708239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.708239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.708239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.708239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.708239] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:350c1d59-c288-4a60-872e-cc51c2f13eb2 already deleted. [ 558.709187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-350c1d59-c288-4a60-872e-cc51c2f13eb2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.296401] env[62909]: INFO networking_nsxv3.common.synchronization [None req-0d173c5a-4807-48a5-8a99-e26415264d44 None None] Enqueued Resource ID: 8f21086b-0cd1-4ea1-9579-d0598e697e6a with Priority: HIGHEST for action port [ 559.297021] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f21086b-0cd1-4ea1-9579-d0598e697e6a with Priority: HIGHEST for action port [ 559.297779] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f21086b-0cd1-4ea1-9579-d0598e697e6a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.297779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f21086b-0cd1-4ea1-9579-d0598e697e6a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.297779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f21086b-0cd1-4ea1-9579-d0598e697e6a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.297779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f21086b-0cd1-4ea1-9579-d0598e697e6a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.297978] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f21086b-0cd1-4ea1-9579-d0598e697e6a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.806414] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f21086b-0cd1-4ea1-9579-d0598e697e6a [ 559.806652] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.806790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.806861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.807099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.807193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.807287] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f21086b-0cd1-4ea1-9579-d0598e697e6a already deleted. [ 559.807389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f21086b-0cd1-4ea1-9579-d0598e697e6a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 560.601855] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ba5b4263-ac9c-48e3-9ab9-62b9c1d96137 None None] Enqueued Resource ID: 921c1413-c305-49a6-a7ea-706dc1cfce57 with Priority: HIGHEST for action port [ 560.601855] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 921c1413-c305-49a6-a7ea-706dc1cfce57 with Priority: HIGHEST for action port [ 560.602385] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-921c1413-c305-49a6-a7ea-706dc1cfce57 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.602510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-921c1413-c305-49a6-a7ea-706dc1cfce57" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 560.602575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-921c1413-c305-49a6-a7ea-706dc1cfce57" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.602824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-921c1413-c305-49a6-a7ea-706dc1cfce57" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 560.602902] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('921c1413-c305-49a6-a7ea-706dc1cfce57',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.958904] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ef2e3ad5-9043-4e84-bcc5-26abd39c7957 None None] Enqueued Resource ID: 93e41f1e-78f6-433f-a8ee-8698cf7b1ef1 with Priority: HIGHEST for action port [ 560.959143] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93e41f1e-78f6-433f-a8ee-8698cf7b1ef1 with Priority: HIGHEST for action port [ 560.959797] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-93e41f1e-78f6-433f-a8ee-8698cf7b1ef1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.959995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93e41f1e-78f6-433f-a8ee-8698cf7b1ef1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 560.960171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93e41f1e-78f6-433f-a8ee-8698cf7b1ef1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.960525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93e41f1e-78f6-433f-a8ee-8698cf7b1ef1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 560.960601] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93e41f1e-78f6-433f-a8ee-8698cf7b1ef1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.107301] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 921c1413-c305-49a6-a7ea-706dc1cfce57 [ 561.108364] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.108364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.108364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.108364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.108364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.108364] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:921c1413-c305-49a6-a7ea-706dc1cfce57 already deleted. [ 561.108364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-921c1413-c305-49a6-a7ea-706dc1cfce57" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.466835] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93e41f1e-78f6-433f-a8ee-8698cf7b1ef1 [ 561.467081] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.467404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.467404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.467516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.467564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.467745] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93e41f1e-78f6-433f-a8ee-8698cf7b1ef1 already deleted. [ 561.467745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93e41f1e-78f6-433f-a8ee-8698cf7b1ef1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.473607] env[62909]: INFO networking_nsxv3.common.synchronization [None req-f00c0a26-975a-41c8-a3e0-3989a8bc976e None None] Enqueued Resource ID: fbaa5b19-6826-41c5-b06e-09a387fa1bb4 with Priority: HIGHEST for action port [ 561.473654] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbaa5b19-6826-41c5-b06e-09a387fa1bb4 with Priority: HIGHEST for action port [ 561.474262] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbaa5b19-6826-41c5-b06e-09a387fa1bb4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.474388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbaa5b19-6826-41c5-b06e-09a387fa1bb4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.474540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbaa5b19-6826-41c5-b06e-09a387fa1bb4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.474691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbaa5b19-6826-41c5-b06e-09a387fa1bb4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.474885] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbaa5b19-6826-41c5-b06e-09a387fa1bb4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.978802] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbaa5b19-6826-41c5-b06e-09a387fa1bb4 [ 561.978802] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.978802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.978802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.978802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.978802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.978802] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbaa5b19-6826-41c5-b06e-09a387fa1bb4 already deleted. [ 561.979330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbaa5b19-6826-41c5-b06e-09a387fa1bb4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.215183] env[62909]: INFO networking_nsxv3.common.synchronization [None req-2b1e08f9-a756-48f4-a0c1-eb70391381b0 None None] Enqueued Resource ID: 675abe6c-ed7d-4a2e-8167-acacac0fb710 with Priority: HIGHEST for action port [ 562.215802] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 675abe6c-ed7d-4a2e-8167-acacac0fb710 with Priority: HIGHEST for action port [ 562.216089] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-675abe6c-ed7d-4a2e-8167-acacac0fb710 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.216224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-675abe6c-ed7d-4a2e-8167-acacac0fb710" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.216279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-675abe6c-ed7d-4a2e-8167-acacac0fb710" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.217410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-675abe6c-ed7d-4a2e-8167-acacac0fb710" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.217410] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('675abe6c-ed7d-4a2e-8167-acacac0fb710',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.720390] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 675abe6c-ed7d-4a2e-8167-acacac0fb710 [ 562.720625] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.720756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.720829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.721041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.721133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.721222] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:675abe6c-ed7d-4a2e-8167-acacac0fb710 already deleted. [ 562.721298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-675abe6c-ed7d-4a2e-8167-acacac0fb710" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.363489] env[62909]: INFO networking_nsxv3.common.synchronization [None req-cfb563fc-472a-4ae0-afb3-a4b6922e52d1 None None] Enqueued Resource ID: 83be06f9-029f-4793-b426-0ce1ff39e37b with Priority: HIGHEST for action port [ 563.363768] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83be06f9-029f-4793-b426-0ce1ff39e37b with Priority: HIGHEST for action port [ 563.366896] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-83be06f9-029f-4793-b426-0ce1ff39e37b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.366896] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83be06f9-029f-4793-b426-0ce1ff39e37b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.366896] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83be06f9-029f-4793-b426-0ce1ff39e37b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.366896] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83be06f9-029f-4793-b426-0ce1ff39e37b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.366896] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83be06f9-029f-4793-b426-0ce1ff39e37b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.871415] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83be06f9-029f-4793-b426-0ce1ff39e37b [ 563.871607] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.872437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.872437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.872437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.872437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.872437] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83be06f9-029f-4793-b426-0ce1ff39e37b already deleted. [ 563.872437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83be06f9-029f-4793-b426-0ce1ff39e37b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.757450] env[62909]: INFO networking_nsxv3.common.synchronization [None req-464777e8-4a36-4395-a660-c2f1438e21fe None None] Enqueued Resource ID: 1ab40c96-d7ae-4252-98e5-4ed7adf6873e with Priority: HIGHEST for action port [ 564.760137] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab40c96-d7ae-4252-98e5-4ed7adf6873e with Priority: HIGHEST for action port [ 564.763962] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ab40c96-d7ae-4252-98e5-4ed7adf6873e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.764130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ab40c96-d7ae-4252-98e5-4ed7adf6873e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.764200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ab40c96-d7ae-4252-98e5-4ed7adf6873e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.764464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ab40c96-d7ae-4252-98e5-4ed7adf6873e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.764550] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ab40c96-d7ae-4252-98e5-4ed7adf6873e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.114097] env[62909]: INFO networking_nsxv3.common.synchronization [None req-a7232ffa-56fe-46be-94c4-582ddf82a053 None None] Enqueued Resource ID: 98dddc6f-008a-40b8-8cd4-1f1b4d6e0d89 with Priority: HIGHEST for action port [ 565.114368] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98dddc6f-008a-40b8-8cd4-1f1b4d6e0d89 with Priority: HIGHEST for action port [ 565.114971] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-98dddc6f-008a-40b8-8cd4-1f1b4d6e0d89 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.115599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98dddc6f-008a-40b8-8cd4-1f1b4d6e0d89" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.115599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98dddc6f-008a-40b8-8cd4-1f1b4d6e0d89" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.115599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98dddc6f-008a-40b8-8cd4-1f1b4d6e0d89" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.115599] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98dddc6f-008a-40b8-8cd4-1f1b4d6e0d89',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.268525] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ab40c96-d7ae-4252-98e5-4ed7adf6873e [ 565.268681] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.268925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.268925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.269177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.269268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.269374] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ab40c96-d7ae-4252-98e5-4ed7adf6873e already deleted. [ 565.269729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ab40c96-d7ae-4252-98e5-4ed7adf6873e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.364078] env[62909]: INFO networking_nsxv3.common.synchronization [None req-cf696d27-4866-4a8f-8720-649f70c12645 tempest-ServersTestBootFromVolume-1983048922 tempest-ServersTestBootFromVolume-1983048922-project-member] Enqueued Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_rules [ 565.364709] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_rules [ 565.365041] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9854b6b4-9fde-4807-83f9-b2838c42920a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.365178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.365245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.365527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.365629] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9854b6b4-9fde-4807-83f9-b2838c42920a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.618710] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98dddc6f-008a-40b8-8cd4-1f1b4d6e0d89 [ 565.619062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.619631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.619631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.619804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.620041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.620291] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98dddc6f-008a-40b8-8cd4-1f1b4d6e0d89 already deleted. [ 565.621697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98dddc6f-008a-40b8-8cd4-1f1b4d6e0d89" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.653062] env[62909]: INFO networking_nsxv3.common.synchronization [None req-6e907b09-0876-411a-a297-35d30392381b tempest-ServersTestBootFromVolume-1983048922 tempest-ServersTestBootFromVolume-1983048922-project-member] Enqueued Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_rules [ 565.656517] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_rules [ 565.657139] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9854b6b4-9fde-4807-83f9-b2838c42920a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.657342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.895305] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.895612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.895612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.895889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.895958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.896067] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9854b6b4-9fde-4807-83f9-b2838c42920a already deleted. [ 565.896146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.896339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.896451] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.896528] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9854b6b4-9fde-4807-83f9-b2838c42920a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.398169] env[62909]: INFO networking_nsxv3.common.synchronization [None req-92ce5d97-be25-43fc-85a6-20e851e26bd8 None None] Enqueued Resource ID: fff48286-2bee-4285-b785-e6acc4dbb72e with Priority: HIGHEST for action port [ 566.398169] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff48286-2bee-4285-b785-e6acc4dbb72e with Priority: HIGHEST for action port [ 566.403127] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-fff48286-2bee-4285-b785-e6acc4dbb72e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.403127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fff48286-2bee-4285-b785-e6acc4dbb72e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.403127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fff48286-2bee-4285-b785-e6acc4dbb72e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.403427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fff48286-2bee-4285-b785-e6acc4dbb72e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.403478] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff48286-2bee-4285-b785-e6acc4dbb72e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.423325] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.423325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.423325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.423325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.423325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.423325] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9854b6b4-9fde-4807-83f9-b2838c42920a already deleted. [ 566.423325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.671689] env[62909]: INFO networking_nsxv3.common.synchronization [None req-6f99de96-b966-416a-921e-874b46cc257c None None] Enqueued Resource ID: e76cbccb-d3b5-48aa-b6c1-9a95688ab3f1 with Priority: HIGHEST for action port [ 566.671689] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e76cbccb-d3b5-48aa-b6c1-9a95688ab3f1 with Priority: HIGHEST for action port [ 566.672071] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-e76cbccb-d3b5-48aa-b6c1-9a95688ab3f1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.672071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e76cbccb-d3b5-48aa-b6c1-9a95688ab3f1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.672071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e76cbccb-d3b5-48aa-b6c1-9a95688ab3f1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.672317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e76cbccb-d3b5-48aa-b6c1-9a95688ab3f1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.674069] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e76cbccb-d3b5-48aa-b6c1-9a95688ab3f1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.906307] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fff48286-2bee-4285-b785-e6acc4dbb72e [ 566.907910] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.907910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.907910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.907910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.908542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.908542] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fff48286-2bee-4285-b785-e6acc4dbb72e already deleted. [ 566.908542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fff48286-2bee-4285-b785-e6acc4dbb72e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.181480] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e76cbccb-d3b5-48aa-b6c1-9a95688ab3f1 [ 567.181480] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.181480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.181480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.181480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.181480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.181480] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e76cbccb-d3b5-48aa-b6c1-9a95688ab3f1 already deleted. [ 567.181480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e76cbccb-d3b5-48aa-b6c1-9a95688ab3f1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.117479] env[62909]: INFO networking_nsxv3.common.synchronization [None req-698ba37f-4a3a-4f06-9bb0-838210a058c6 None None] Enqueued Resource ID: 96d270c0-56d3-4320-a31a-7e3b095176e5 with Priority: HIGHEST for action port [ 568.118473] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96d270c0-56d3-4320-a31a-7e3b095176e5 with Priority: HIGHEST for action port [ 568.118642] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-96d270c0-56d3-4320-a31a-7e3b095176e5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.118751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96d270c0-56d3-4320-a31a-7e3b095176e5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.119151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96d270c0-56d3-4320-a31a-7e3b095176e5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.122560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96d270c0-56d3-4320-a31a-7e3b095176e5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.122560] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96d270c0-56d3-4320-a31a-7e3b095176e5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.622038] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96d270c0-56d3-4320-a31a-7e3b095176e5 [ 568.622038] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.622270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.622270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.622382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.622466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.622557] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96d270c0-56d3-4320-a31a-7e3b095176e5 already deleted. [ 568.622631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96d270c0-56d3-4320-a31a-7e3b095176e5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.641643] env[62909]: INFO networking_nsxv3.common.synchronization [None req-0afe0ed9-0b59-4fe7-beeb-8c895e276051 None None] Enqueued Resource ID: 2dfe450d-096c-4f0e-83f8-a0ebe056976f with Priority: HIGHEST for action port [ 569.641922] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dfe450d-096c-4f0e-83f8-a0ebe056976f with Priority: HIGHEST for action port [ 569.642558] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dfe450d-096c-4f0e-83f8-a0ebe056976f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.642690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dfe450d-096c-4f0e-83f8-a0ebe056976f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.642773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dfe450d-096c-4f0e-83f8-a0ebe056976f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.642993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dfe450d-096c-4f0e-83f8-a0ebe056976f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.643331] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dfe450d-096c-4f0e-83f8-a0ebe056976f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.898686] env[62909]: INFO networking_nsxv3.common.synchronization [req-31b2cf93-d688-45d9-84dd-17ec85efa0c8 req-28950acb-cb0d-4934-847e-0a324b9c6518 tempest-ServerDiagnosticsNegativeTest-45432392 tempest-ServerDiagnosticsNegativeTest-45432392-project-member] Enqueued Resource ID: cdf04703-55f3-479f-bb4c-a69bd221f98f with Priority: HIGHEST for action security_group_members [ 569.898954] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf04703-55f3-479f-bb4c-a69bd221f98f with Priority: HIGHEST for action security_group_members [ 569.899288] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf04703-55f3-479f-bb4c-a69bd221f98f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.899405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.899475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.900499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.900676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.900789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.900856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.901134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.901222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.901320] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf04703-55f3-479f-bb4c-a69bd221f98f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.145279] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2dfe450d-096c-4f0e-83f8-a0ebe056976f [ 570.145506] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.146331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.146422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.146623] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.146713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.146823] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2dfe450d-096c-4f0e-83f8-a0ebe056976f already deleted. [ 570.146907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dfe450d-096c-4f0e-83f8-a0ebe056976f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.404323] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.404478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.404554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.405190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.405190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.405190] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.405190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.405190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.405387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.405387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.405498] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf04703-55f3-479f-bb4c-a69bd221f98f already deleted. [ 570.405553] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.866440] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b4894064-d4ec-4833-8b80-d9b6a24724d2 None None] Enqueued Resource ID: d4f335c0-ca9c-4bc3-8d13-9928fd45aa1d with Priority: HIGHEST for action port [ 570.866964] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f335c0-ca9c-4bc3-8d13-9928fd45aa1d with Priority: HIGHEST for action port [ 570.868370] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4f335c0-ca9c-4bc3-8d13-9928fd45aa1d taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.868370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4f335c0-ca9c-4bc3-8d13-9928fd45aa1d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.868370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4f335c0-ca9c-4bc3-8d13-9928fd45aa1d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.868577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4f335c0-ca9c-4bc3-8d13-9928fd45aa1d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.868577] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4f335c0-ca9c-4bc3-8d13-9928fd45aa1d',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.163276] env[62909]: INFO networking_nsxv3.common.synchronization [req-0ac08062-b789-40f1-b0a7-f1aadccfc6c5 req-d3e609f8-453d-4b07-bb72-49ad29d473a6 tempest-ServersAdminNegativeTestJSON-1035945787 tempest-ServersAdminNegativeTestJSON-1035945787-project-member] Enqueued Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 571.163276] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 571.163276] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.163276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.163276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.163276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.163276] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.163276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.163276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.163276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.164477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.164477] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.374991] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4f335c0-ca9c-4bc3-8d13-9928fd45aa1d [ 571.374991] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.374991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.374991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.374991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.374991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.374991] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4f335c0-ca9c-4bc3-8d13-9928fd45aa1d already deleted. [ 571.374991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4f335c0-ca9c-4bc3-8d13-9928fd45aa1d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.632512] env[62909]: INFO networking_nsxv3.common.synchronization [None req-9f553bc3-d47a-4295-9720-a688c0b8ff2a None None] Enqueued Resource ID: 792933fc-4e3e-46fc-8699-c9f58614ae47 with Priority: HIGHEST for action port [ 571.634105] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792933fc-4e3e-46fc-8699-c9f58614ae47 with Priority: HIGHEST for action port [ 571.634774] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-792933fc-4e3e-46fc-8699-c9f58614ae47 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.634774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-792933fc-4e3e-46fc-8699-c9f58614ae47" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.634774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-792933fc-4e3e-46fc-8699-c9f58614ae47" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.634934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-792933fc-4e3e-46fc-8699-c9f58614ae47" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.634934] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('792933fc-4e3e-46fc-8699-c9f58614ae47',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.666032] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.668483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.668483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.668483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.668483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.668483] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.668483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.668483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.668483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.668483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.668483] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d635d2b-1797-4206-b032-b7450c1074bc already deleted. [ 571.668483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.137514] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 792933fc-4e3e-46fc-8699-c9f58614ae47 [ 572.137755] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.137835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.137895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.138133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.138307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.138466] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:792933fc-4e3e-46fc-8699-c9f58614ae47 already deleted. [ 572.138538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-792933fc-4e3e-46fc-8699-c9f58614ae47" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.237957] env[62909]: INFO networking_nsxv3.common.synchronization [None req-7953c797-6728-48ef-9505-a9a51eb02c17 None None] Enqueued Resource ID: 8efae44a-bdc5-4160-b6c5-dff1abc8f27a with Priority: HIGHEST for action port [ 572.239773] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8efae44a-bdc5-4160-b6c5-dff1abc8f27a with Priority: HIGHEST for action port [ 572.240340] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-8efae44a-bdc5-4160-b6c5-dff1abc8f27a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.241954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8efae44a-bdc5-4160-b6c5-dff1abc8f27a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.241954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8efae44a-bdc5-4160-b6c5-dff1abc8f27a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.241954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8efae44a-bdc5-4160-b6c5-dff1abc8f27a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.241954] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8efae44a-bdc5-4160-b6c5-dff1abc8f27a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.315275] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.315275] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.315275] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.320378] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.320378] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.320378] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.320378] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.322821] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.322821] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.322821] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 572.322821] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 572.322821] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 572.322821] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 572.322821] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 572.322821] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 572.322821] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 572.349676] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 572.349676] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 572.349676] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 572.349676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.349676] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-90a32b17-6fbf-4efa-99d6-610bd414847b taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.349676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-90a32b17-6fbf-4efa-99d6-610bd414847b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.349676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-90a32b17-6fbf-4efa-99d6-610bd414847b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.349676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-90a32b17-6fbf-4efa-99d6-610bd414847b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.349676] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90a32b17-6fbf-4efa-99d6-610bd414847b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.748478] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8efae44a-bdc5-4160-b6c5-dff1abc8f27a [ 572.749970] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.749970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.749970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.749970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.749970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.749970] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8efae44a-bdc5-4160-b6c5-dff1abc8f27a already deleted. [ 572.749970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8efae44a-bdc5-4160-b6c5-dff1abc8f27a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.855594] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.858507] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.858507] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.858507] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.858507] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.858507] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 90a32b17-6fbf-4efa-99d6-610bd414847b not found, creating... [ 572.858507] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.858977] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.858977] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.858977] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.859143] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.859518] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.859673] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.859796] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.860591] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.860591] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.860591] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 90a32b17-6fbf-4efa-99d6-610bd414847b is going to be created. [ 572.875254] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.875373] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.875491] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.875705] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.876048] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.876205] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.876323] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.876545] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.876683] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.876885] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 572.876994] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 572.877312] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 572.877361] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 572.877479] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 572.877598] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 572.877733] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 572.886730] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.886943] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.887356] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.887676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.887968] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.888411] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-90a32b17-6fbf-4efa-99d6-610bd414847b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.902802] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 572.902802] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 572.902802] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 572.902802] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.903114] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-59265cbb-d823-43dc-a07d-d850de95a7d8 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.904833] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-59265cbb-d823-43dc-a07d-d850de95a7d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.904833] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-59265cbb-d823-43dc-a07d-d850de95a7d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.904833] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-59265cbb-d823-43dc-a07d-d850de95a7d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.904833] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59265cbb-d823-43dc-a07d-d850de95a7d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.109327] env[62909]: INFO networking_nsxv3.common.synchronization [req-0aca7b03-b3d9-4bdf-bc41-f6dae0316e75 req-e786afc1-cb01-472a-a738-707660daad62 tempest-DeleteServersAdminTestJSON-1896056451 tempest-DeleteServersAdminTestJSON-1896056451-project-member] Enqueued Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 573.112313] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 573.113059] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.113205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.113291] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.113555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.114411] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.114598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.114671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.114868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.114961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.116144] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.407327] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.407615] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.408141] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.408469] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.408653] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.409052] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 59265cbb-d823-43dc-a07d-d850de95a7d8 not found, creating... [ 573.409687] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.410340] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.410340] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.410473] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.410686] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.411079] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.411460] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.411460] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.412281] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.414064] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.414064] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 59265cbb-d823-43dc-a07d-d850de95a7d8 is going to be created. [ 573.434816] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.435047] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.435171] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.435454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.435679] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.435921] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-59265cbb-d823-43dc-a07d-d850de95a7d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.603874] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b2a4e399-2fae-4b78-898c-069a38d372e5 None None] Enqueued Resource ID: f3b99b2c-db5b-43e0-be3e-ca6fad1d32fa with Priority: HIGHEST for action port [ 573.604574] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b99b2c-db5b-43e0-be3e-ca6fad1d32fa with Priority: HIGHEST for action port [ 573.604915] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3b99b2c-db5b-43e0-be3e-ca6fad1d32fa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.605468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3b99b2c-db5b-43e0-be3e-ca6fad1d32fa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.605468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3b99b2c-db5b-43e0-be3e-ca6fad1d32fa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.605468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3b99b2c-db5b-43e0-be3e-ca6fad1d32fa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.605468] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3b99b2c-db5b-43e0-be3e-ca6fad1d32fa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.622696] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.622696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.622696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.622967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.622967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.623828] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.623828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.623828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.623828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.623828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.623828] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 already deleted. [ 573.623828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.882030] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.882249] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.882402] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.882627] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.885231] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.885231] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.885231] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.885231] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.885231] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.885231] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 573.885231] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 573.885231] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 573.885231] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 573.885231] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 573.885231] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 573.885231] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 573.906437] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 573.906895] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 573.906895] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 573.906895] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.907175] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-a977117b-c407-4071-a0e5-5a31734d1025 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.908283] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-a977117b-c407-4071-a0e5-5a31734d1025" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.908283] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-a977117b-c407-4071-a0e5-5a31734d1025" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.908283] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-a977117b-c407-4071-a0e5-5a31734d1025" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.908283] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a977117b-c407-4071-a0e5-5a31734d1025',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.108154] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3b99b2c-db5b-43e0-be3e-ca6fad1d32fa [ 574.108209] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.108367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.108424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.108640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.108809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.108907] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3b99b2c-db5b-43e0-be3e-ca6fad1d32fa already deleted. [ 574.109093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3b99b2c-db5b-43e0-be3e-ca6fad1d32fa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.414844] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.415167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.415167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.415682] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.415682] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.415682] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port a977117b-c407-4071-a0e5-5a31734d1025 not found, creating... [ 574.416319] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.416319] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.416319] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.419360] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.419505] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.419825] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.420050] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.420151] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.420329] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.420458] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.420595] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: a977117b-c407-4071-a0e5-5a31734d1025 is going to be created. [ 574.444796] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.445644] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.446770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.446770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.446770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.446770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-a977117b-c407-4071-a0e5-5a31734d1025" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.467656] env[62909]: INFO networking_nsxv3.common.synchronization [req-31b2cf93-d688-45d9-84dd-17ec85efa0c8 req-b4f80344-d0cf-4738-8da8-f9ec3d386b9d service nova] Enqueued Resource ID: cdf04703-55f3-479f-bb4c-a69bd221f98f with Priority: HIGHEST for action security_group_rules [ 574.468114] env[62909]: INFO networking_nsxv3.common.synchronization [req-31b2cf93-d688-45d9-84dd-17ec85efa0c8 req-b4f80344-d0cf-4738-8da8-f9ec3d386b9d service nova] Enqueued Resource ID: cdf04703-55f3-479f-bb4c-a69bd221f98f with Priority: HIGHEST for action security_group_members [ 574.468425] env[62909]: INFO networking_nsxv3.common.synchronization [req-31b2cf93-d688-45d9-84dd-17ec85efa0c8 req-b4f80344-d0cf-4738-8da8-f9ec3d386b9d service nova] Enqueued Resource ID: 90a32b17-6fbf-4efa-99d6-610bd414847b with Priority: HIGHEST for action port [ 574.468932] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf04703-55f3-479f-bb4c-a69bd221f98f with Priority: HIGHEST for action security_group_rules [ 574.469641] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf04703-55f3-479f-bb4c-a69bd221f98f with Priority: HIGHEST for action security_group_members [ 574.469641] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90a32b17-6fbf-4efa-99d6-610bd414847b with Priority: HIGHEST for action port [ 574.469752] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdf04703-55f3-479f-bb4c-a69bd221f98f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.470016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.470016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.473975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.473975] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdf04703-55f3-479f-bb4c-a69bd221f98f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.476274] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf04703-55f3-479f-bb4c-a69bd221f98f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.476274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.476274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.476274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.476274] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.476274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.476274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.476274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.476274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.476274] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf04703-55f3-479f-bb4c-a69bd221f98f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.478493] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-90a32b17-6fbf-4efa-99d6-610bd414847b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.478651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90a32b17-6fbf-4efa-99d6-610bd414847b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.478727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90a32b17-6fbf-4efa-99d6-610bd414847b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.479029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90a32b17-6fbf-4efa-99d6-610bd414847b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.479115] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90a32b17-6fbf-4efa-99d6-610bd414847b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.780557] env[62909]: INFO networking_nsxv3.common.synchronization [req-0ac08062-b789-40f1-b0a7-f1aadccfc6c5 req-f74b5071-d72b-4e40-afc9-0ad00b2f087a service nova] Enqueued Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_rules [ 574.780557] env[62909]: INFO networking_nsxv3.common.synchronization [req-0ac08062-b789-40f1-b0a7-f1aadccfc6c5 req-f74b5071-d72b-4e40-afc9-0ad00b2f087a service nova] Enqueued Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 574.781038] env[62909]: INFO networking_nsxv3.common.synchronization [req-0ac08062-b789-40f1-b0a7-f1aadccfc6c5 req-f74b5071-d72b-4e40-afc9-0ad00b2f087a service nova] Enqueued Resource ID: 59265cbb-d823-43dc-a07d-d850de95a7d8 with Priority: HIGHEST for action port [ 574.781038] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_rules [ 574.781038] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 574.781038] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59265cbb-d823-43dc-a07d-d850de95a7d8 with Priority: HIGHEST for action port [ 574.782396] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.782561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.782594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.782812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.782885] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.783739] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.783849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.783912] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.784088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.784227] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.784324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.784378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.784509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.784601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.784706] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.790042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-59265cbb-d823-43dc-a07d-d850de95a7d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.790042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59265cbb-d823-43dc-a07d-d850de95a7d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.790042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59265cbb-d823-43dc-a07d-d850de95a7d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.790042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59265cbb-d823-43dc-a07d-d850de95a7d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.790042] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59265cbb-d823-43dc-a07d-d850de95a7d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.981933] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf04703-55f3-479f-bb4c-a69bd221f98f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.981933] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.982669] env[62909]: INFO networking_nsxv3.common.synchronization [req-c8bd7c42-f595-410c-bbae-acddceb44c6f req-903e1160-dfed-410f-aefa-e4db4889e862 tempest-ImagesOneServerTestJSON-1204860044 tempest-ImagesOneServerTestJSON-1204860044-project-member] Enqueued Resource ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc with Priority: HIGHEST for action security_group_members [ 574.983166] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc with Priority: HIGHEST for action security_group_members [ 574.983577] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e434cf-a3e8-49df-8050-fa1d2489f7dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.983577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.983713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.983850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.983993] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.987523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.987523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.987523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.987523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.987523] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73e434cf-a3e8-49df-8050-fa1d2489f7dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.992807] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90a32b17-6fbf-4efa-99d6-610bd414847b with status ACTIVE [ 574.993011] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.993107] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.993200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.993389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.993470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.993794] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.993794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.993902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.994089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.994148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.995897] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.995897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.996116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.996567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.996567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.996567] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90a32b17-6fbf-4efa-99d6-610bd414847b is going to be updated. [ 574.997995] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdf04703-55f3-479f-bb4c-a69bd221f98f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.025251] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.025428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.025479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.025789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.025922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.026159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90a32b17-6fbf-4efa-99d6-610bd414847b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.283222] env[62909]: INFO networking_nsxv3.common.synchronization [None req-52919d49-4610-4604-9bbc-dd9d8cf66075 None None] Enqueued Resource ID: b70bfbd5-aeaa-4ad4-9633-62bf5edd7fd5 with Priority: HIGHEST for action port [ 575.284130] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70bfbd5-aeaa-4ad4-9633-62bf5edd7fd5 with Priority: HIGHEST for action port [ 575.284130] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b70bfbd5-aeaa-4ad4-9633-62bf5edd7fd5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.284342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b70bfbd5-aeaa-4ad4-9633-62bf5edd7fd5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.284342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b70bfbd5-aeaa-4ad4-9633-62bf5edd7fd5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.284615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b70bfbd5-aeaa-4ad4-9633-62bf5edd7fd5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.284700] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70bfbd5-aeaa-4ad4-9633-62bf5edd7fd5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.290596] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.290733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.290892] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.294962] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59265cbb-d823-43dc-a07d-d850de95a7d8 with status ACTIVE [ 575.295067] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.295213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.295280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.295499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.295591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.299031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.299031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.299031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.299031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.299031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.299031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.299031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.299031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.299031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.299031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.299031] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59265cbb-d823-43dc-a07d-d850de95a7d8 is going to be updated. [ 575.321304] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.321304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.321304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.321304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.321493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.321586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59265cbb-d823-43dc-a07d-d850de95a7d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.487831] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.490376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.490376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.490376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.490376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.490376] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.490376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.490376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.490376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.490376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.490376] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc already deleted. [ 575.490376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.501762] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdf04703-55f3-479f-bb4c-a69bd221f98f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.790468] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b70bfbd5-aeaa-4ad4-9633-62bf5edd7fd5 [ 575.795140] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.795140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.795140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.795140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.795140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.795579] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b70bfbd5-aeaa-4ad4-9633-62bf5edd7fd5 already deleted. [ 575.795579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b70bfbd5-aeaa-4ad4-9633-62bf5edd7fd5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.795579] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.862641] env[62909]: INFO networking_nsxv3.common.synchronization [None req-41f58c2f-bcbb-4f83-9bf9-41a38a01048b None None] Enqueued Resource ID: fd26b056-1d8f-4069-863b-5fac63f30454 with Priority: HIGHEST for action port [ 575.863104] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd26b056-1d8f-4069-863b-5fac63f30454 with Priority: HIGHEST for action port [ 575.863521] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd26b056-1d8f-4069-863b-5fac63f30454 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.863592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd26b056-1d8f-4069-863b-5fac63f30454" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.863660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd26b056-1d8f-4069-863b-5fac63f30454" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.863913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd26b056-1d8f-4069-863b-5fac63f30454" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.863994] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd26b056-1d8f-4069-863b-5fac63f30454',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.003932] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.004283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.004283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.004412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.004498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.004592] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf04703-55f3-479f-bb4c-a69bd221f98f is going to be created. [ 576.068293] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.068543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.068605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.068895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.069160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.083740] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf04703-55f3-479f-bb4c-a69bd221f98f in Status: UNINITIALIZED for 2s [ 576.297719] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.297950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.298780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.298780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.298780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.298780] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d635d2b-1797-4206-b032-b7450c1074bc is going to be created. [ 576.329474] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.329474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.329474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.329698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.330443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.345722] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: UNINITIALIZED for 2s [ 576.371406] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd26b056-1d8f-4069-863b-5fac63f30454 [ 576.372191] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.372191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.372191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.372191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.372191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.372388] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd26b056-1d8f-4069-863b-5fac63f30454 already deleted. [ 576.372388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd26b056-1d8f-4069-863b-5fac63f30454" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.844922] env[62909]: INFO networking_nsxv3.common.synchronization [req-0aca7b03-b3d9-4bdf-bc41-f6dae0316e75 req-3e3b6c94-27b7-4c74-befd-3a57d1484bc5 service nova] Enqueued Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_rules [ 576.845210] env[62909]: INFO networking_nsxv3.common.synchronization [req-0aca7b03-b3d9-4bdf-bc41-f6dae0316e75 req-3e3b6c94-27b7-4c74-befd-3a57d1484bc5 service nova] Enqueued Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 576.845260] env[62909]: INFO networking_nsxv3.common.synchronization [req-0aca7b03-b3d9-4bdf-bc41-f6dae0316e75 req-3e3b6c94-27b7-4c74-befd-3a57d1484bc5 service nova] Enqueued Resource ID: a977117b-c407-4071-a0e5-5a31734d1025 with Priority: HIGHEST for action port [ 576.848033] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_rules [ 576.848033] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 576.848033] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a977117b-c407-4071-a0e5-5a31734d1025 with Priority: HIGHEST for action port [ 576.848033] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.848033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.848033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.848033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.848033] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.848295] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.848295] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.848366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.848647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.848647] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.848747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.848825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.848973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.849042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.849187] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.852044] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-a977117b-c407-4071-a0e5-5a31734d1025 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.852182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a977117b-c407-4071-a0e5-5a31734d1025" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.852237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a977117b-c407-4071-a0e5-5a31734d1025" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.852435] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a977117b-c407-4071-a0e5-5a31734d1025" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.852519] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a977117b-c407-4071-a0e5-5a31734d1025',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.918773] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.920243] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-514" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.921076] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-514" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.921076] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-514" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.922342] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.922342] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.922342] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.922665] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.922757] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.922919] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 576.923073] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 576.923146] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 576.925044] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 576.925044] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 576.925044] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 576.925044] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 576.943298] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 576.943925] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 576.944492] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 576.945021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-514" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.945080] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-917f7d2d-3256-481e-9892-13779b20ab0f taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.948016] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-917f7d2d-3256-481e-9892-13779b20ab0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.948016] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-917f7d2d-3256-481e-9892-13779b20ab0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.948016] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-917f7d2d-3256-481e-9892-13779b20ab0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.948016] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917f7d2d-3256-481e-9892-13779b20ab0f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.128216] env[62909]: INFO networking_nsxv3.common.synchronization [None req-aa0b8ff1-04ab-49ae-9274-33a80b506a85 tempest-VolumesAssistedSnapshotsTest-1541736566 tempest-VolumesAssistedSnapshotsTest-1541736566-project-member] Enqueued Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_rules [ 577.128216] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_rules [ 577.128216] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2821bc4-3047-4598-bd51-10cd2a5b1137 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.128216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.128216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.128216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.128216] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.363614] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.363614] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.363614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.363614] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a977117b-c407-4071-a0e5-5a31734d1025 with status ACTIVE [ 577.363614] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.363614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.363614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.363614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.363614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.363614] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.363614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.363614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.363614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.363614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.364586] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.364586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.364586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.364586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.364586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.364842] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a977117b-c407-4071-a0e5-5a31734d1025 is going to be updated. [ 577.388838] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.389345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.389581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.389967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.390278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.390601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a977117b-c407-4071-a0e5-5a31734d1025" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.453161] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.453161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.453161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.453161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.453161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.453161] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 917f7d2d-3256-481e-9892-13779b20ab0f not found, creating... [ 577.453161] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.453161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.453161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.453161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.453161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.453571] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.453571] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.453571] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.453571] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.453571] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.453571] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 917f7d2d-3256-481e-9892-13779b20ab0f is going to be created. [ 577.487767] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.488297] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.488568] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.488960] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.489311] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.490067] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-917f7d2d-3256-481e-9892-13779b20ab0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.652624] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.652770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.652841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.653073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.653168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.653269] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 already deleted. [ 577.653362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.731901] env[62909]: INFO networking_nsxv3.common.synchronization [None req-1356bcb2-d01e-41f6-be87-ffd5b9294a4b tempest-VolumesAssistedSnapshotsTest-1541736566 tempest-VolumesAssistedSnapshotsTest-1541736566-project-member] Enqueued Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_rules [ 577.732847] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_rules [ 577.733294] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2821bc4-3047-4598-bd51-10cd2a5b1137 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.733532] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.733703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.733981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.734166] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.862083] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.100037] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf04703-55f3-479f-bb4c-a69bd221f98f in Status: SUCCESS [ 578.100037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.100037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.100037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.100037] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.100037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.100037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.100037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.100037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.100037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.100037] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdf04703-55f3-479f-bb4c-a69bd221f98f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.149715] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b566956d-35e1-4425-a3c8-b673b10a7707 None None] Enqueued Resource ID: e497850c-1bb9-40c0-88d2-1a854dc8b08a with Priority: HIGHEST for action port [ 578.150660] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e497850c-1bb9-40c0-88d2-1a854dc8b08a with Priority: HIGHEST for action port [ 578.151077] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-e497850c-1bb9-40c0-88d2-1a854dc8b08a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.151269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e497850c-1bb9-40c0-88d2-1a854dc8b08a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.151476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e497850c-1bb9-40c0-88d2-1a854dc8b08a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.152024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e497850c-1bb9-40c0-88d2-1a854dc8b08a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.152024] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e497850c-1bb9-40c0-88d2-1a854dc8b08a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.259708] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.262869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.262869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.263088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.263683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.263683] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 already deleted. [ 578.263683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.303513] env[62909]: INFO networking_nsxv3.common.synchronization [None req-193172b7-77d1-47c7-992b-d305489f8183 None None] Enqueued Resource ID: d6106d55-fa57-473f-a47c-fa488d9bd4a6 with Priority: HIGHEST for action port [ 578.304784] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6106d55-fa57-473f-a47c-fa488d9bd4a6 with Priority: HIGHEST for action port [ 578.305455] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6106d55-fa57-473f-a47c-fa488d9bd4a6 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.305455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6106d55-fa57-473f-a47c-fa488d9bd4a6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.305455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6106d55-fa57-473f-a47c-fa488d9bd4a6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.305714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6106d55-fa57-473f-a47c-fa488d9bd4a6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.305765] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6106d55-fa57-473f-a47c-fa488d9bd4a6',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.359092] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: SUCCESS [ 578.359300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.359508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.361026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.361026] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.361026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.361026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.361026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.361026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.361026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.361026] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.364439] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.364574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.364635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.364813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.364891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.364979] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 is going to be created. [ 578.390535] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.390715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.390920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.390960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.391160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.403191] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: UNINITIALIZED for 2s [ 578.608602] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf04703-55f3-479f-bb4c-a69bd221f98f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.608795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.608857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.609635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.609635] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.609635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.609635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.609635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.609793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.609993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.610173] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf04703-55f3-479f-bb4c-a69bd221f98f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.610266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.610325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.610472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.610600] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.610691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.610758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.610892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.611864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.611864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.611864] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdf04703-55f3-479f-bb4c-a69bd221f98f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.656520] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e497850c-1bb9-40c0-88d2-1a854dc8b08a [ 578.656775] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.656915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.656997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.657201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.657384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.657384] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e497850c-1bb9-40c0-88d2-1a854dc8b08a already deleted. [ 578.657444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e497850c-1bb9-40c0-88d2-1a854dc8b08a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.811622] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6106d55-fa57-473f-a47c-fa488d9bd4a6 [ 578.811622] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.811622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.811622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.811622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.811622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.811622] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6106d55-fa57-473f-a47c-fa488d9bd4a6 already deleted. [ 578.811622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6106d55-fa57-473f-a47c-fa488d9bd4a6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.864886] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.865430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.866939] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.867279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.867522] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.867677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.867790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.868373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.868373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.868453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.868632] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.868764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.868860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.869052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.869238] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.871947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.871947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.871947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.871947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.871947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.871947] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.935333] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e0b22aec-785a-418d-bf07-33271313c64d tempest-ServersWithSpecificFlavorTestJSON-184799251 tempest-ServersWithSpecificFlavorTestJSON-184799251-project-member] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_rules [ 578.935865] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_rules [ 578.936168] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.936294] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.936361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.936652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.939746] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.016983] env[62909]: INFO networking_nsxv3.common.synchronization [req-29faac43-3211-4bcb-822c-810599611adc req-b045d57a-3b12-4f16-a929-ead88471b9b2 tempest-InstanceActionsTestJSON-94509073 tempest-InstanceActionsTestJSON-94509073-project-member] Enqueued Resource ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 with Priority: HIGHEST for action security_group_members [ 579.017248] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 with Priority: HIGHEST for action security_group_members [ 579.017713] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2b03ac3-37c4-4e87-91a0-aaa294062815 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.018098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.021198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.021782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.025012] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.025012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.025012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.025012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.025012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.025012] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2b03ac3-37c4-4e87-91a0-aaa294062815',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.115137] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdf04703-55f3-479f-bb4c-a69bd221f98f: rpc.has_security_group_logging(os_id): False [ 579.137098] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.137098] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.137098] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.137098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.137705] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.137705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.137705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.137705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.137705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.137705] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdf04703-55f3-479f-bb4c-a69bd221f98f is going to be created. [ 579.223758] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.223758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.223758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.224696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.224696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.234870] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf04703-55f3-479f-bb4c-a69bd221f98f in Status: IN_PROGRESS for 2s [ 579.377285] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d635d2b-1797-4206-b032-b7450c1074bc: rpc.has_security_group_logging(os_id): False [ 579.401741] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.401741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.401741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.401741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.401741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.401741] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.402032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.402032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.402179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.402229] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.402376] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.402512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.402543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.402721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.402782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.404647] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.404886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.404886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.405344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.405471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.405568] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d635d2b-1797-4206-b032-b7450c1074bc is going to be created. [ 579.463266] env[62909]: INFO networking_nsxv3.common.synchronization [req-c8bd7c42-f595-410c-bbae-acddceb44c6f req-01460ec5-e052-4c7c-96f1-8478178f0285 service nova] Enqueued Resource ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc with Priority: HIGHEST for action security_group_rules [ 579.463266] env[62909]: INFO networking_nsxv3.common.synchronization [req-c8bd7c42-f595-410c-bbae-acddceb44c6f req-01460ec5-e052-4c7c-96f1-8478178f0285 service nova] Enqueued Resource ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc with Priority: HIGHEST for action security_group_members [ 579.463266] env[62909]: INFO networking_nsxv3.common.synchronization [req-c8bd7c42-f595-410c-bbae-acddceb44c6f req-01460ec5-e052-4c7c-96f1-8478178f0285 service nova] Enqueued Resource ID: 917f7d2d-3256-481e-9892-13779b20ab0f with Priority: HIGHEST for action port [ 579.463855] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.463855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.463855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.464038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.464251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.464373] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 already deleted. [ 579.465947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.465947] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc with Priority: HIGHEST for action security_group_rules [ 579.465947] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc with Priority: HIGHEST for action security_group_members [ 579.465947] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 917f7d2d-3256-481e-9892-13779b20ab0f with Priority: HIGHEST for action port [ 579.470391] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.470391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.470391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.470391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.470391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.475777] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73e434cf-a3e8-49df-8050-fa1d2489f7dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.475777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.475777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.475777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.475777] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73e434cf-a3e8-49df-8050-fa1d2489f7dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.476708] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e434cf-a3e8-49df-8050-fa1d2489f7dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.476708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.476793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.479231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.479231] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.479231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.479231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.479231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.479231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.479231] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73e434cf-a3e8-49df-8050-fa1d2489f7dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.479622] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-917f7d2d-3256-481e-9892-13779b20ab0f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.479622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-917f7d2d-3256-481e-9892-13779b20ab0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.479840] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-917f7d2d-3256-481e-9892-13779b20ab0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.479840] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-917f7d2d-3256-481e-9892-13779b20ab0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.479908] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917f7d2d-3256-481e-9892-13779b20ab0f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.493990] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: IN_PROGRESS for 2s [ 579.529351] env[62909]: INFO networking_nsxv3.common.synchronization [None req-6b76c127-32a3-4f49-9e39-8141af9ee27c tempest-ServersWithSpecificFlavorTestJSON-184799251 tempest-ServersWithSpecificFlavorTestJSON-184799251-project-member] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_rules [ 579.534016] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_rules [ 579.534016] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.534016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.534016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.535937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.535937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.535937] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.535937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.535937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.535937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.541438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.541438] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 already deleted. [ 579.541438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.541438] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.541438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.541438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.541438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.541438] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.985035] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e434cf-a3e8-49df-8050-fa1d2489f7dc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.985035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.985035] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73e434cf-a3e8-49df-8050-fa1d2489f7dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.985035] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 917f7d2d-3256-481e-9892-13779b20ab0f with status ACTIVE [ 579.985827] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.985827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.985827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.985827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.985827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.986012] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.986053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.986093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.986315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.986315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.987179] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.987179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.987179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.987179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.987179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.987179] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 917f7d2d-3256-481e-9892-13779b20ab0f is going to be updated. [ 580.020086] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.020446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.020536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.020754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.020902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.021413] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-917f7d2d-3256-481e-9892-13779b20ab0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.066149] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.066149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.066149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.066149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.066149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.066149] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 already deleted. [ 580.066149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.340576] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.340816] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-139" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.340908] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-139" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.341284] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-139" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.341575] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.341751] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.341988] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.343117] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.346109] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.346109] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 580.346109] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 580.346109] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 580.346109] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 580.346109] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 580.346109] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 580.346109] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 580.371860] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 580.372080] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 580.374314] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 580.374314] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-139" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.374314] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.374314] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.374314] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.374314] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.374314] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.416990] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: SUCCESS [ 580.416990] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.417507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.418024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.418283] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.418456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.418572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.418764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.419127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.419293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.420452] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.486335] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73e434cf-a3e8-49df-8050-fa1d2489f7dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.523086] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ae11f79e-c591-404f-bf50-1e0258fd4e58 None None] Enqueued Resource ID: 2b7ece93-f7a3-4ac3-872b-bded7c08bf00 with Priority: HIGHEST for action port [ 580.523980] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7ece93-f7a3-4ac3-872b-bded7c08bf00 with Priority: HIGHEST for action port [ 580.524363] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b7ece93-f7a3-4ac3-872b-bded7c08bf00 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.524552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b7ece93-f7a3-4ac3-872b-bded7c08bf00" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.524603] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b7ece93-f7a3-4ac3-872b-bded7c08bf00" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.524881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b7ece93-f7a3-4ac3-872b-bded7c08bf00" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.524969] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b7ece93-f7a3-4ac3-872b-bded7c08bf00',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.774506] env[62909]: INFO networking_nsxv3.common.synchronization [req-e2943893-8d8d-460c-b5e7-1c2185af2992 req-d072a88f-920e-4d53-a842-564c6b0956ab tempest-ServerDiagnosticsTest-352645101 tempest-ServerDiagnosticsTest-352645101-project-member] Enqueued Resource ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 with Priority: HIGHEST for action security_group_members [ 580.774594] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 with Priority: HIGHEST for action security_group_members [ 580.775062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f700c8-ea6e-4561-84ab-c40836ff4286 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.775341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.775415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.775646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.775936] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.776024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.776097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.776280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.776369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.776472] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f700c8-ea6e-4561-84ab-c40836ff4286',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.878353] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.878676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.878826] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.879972] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.879972] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.879972] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0 not found, creating... [ 580.879972] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.879972] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.880319] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.880423] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.880569] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.880897] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.884319] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.884319] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.884473] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.885385] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.885385] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0 is going to be created. [ 580.912699] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.913009] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.913209] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.913588] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.913999] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.914332] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.925858] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.926151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.926271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.926579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.932197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.932197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.932197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.932197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.932197] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.990463] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.990463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.990463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.990463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.992699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.992699] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc is going to be created. [ 581.031389] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b7ece93-f7a3-4ac3-872b-bded7c08bf00 [ 581.031703] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.031995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.031995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.032497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.032742] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.032742] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b7ece93-f7a3-4ac3-872b-bded7c08bf00 already deleted. [ 581.032953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b7ece93-f7a3-4ac3-872b-bded7c08bf00" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.043849] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.043997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.044278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.044361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.045749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.062663] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc in Status: UNINITIALIZED for 2s [ 581.170681] env[62909]: INFO networking_nsxv3.common.synchronization [None req-3c145b75-0c0c-4858-8bb8-18497d1af7e8 None None] Enqueued Resource ID: 06ed5ca3-afe1-48b7-ad8d-e0f35eefafa7 with Priority: HIGHEST for action port [ 581.170906] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06ed5ca3-afe1-48b7-ad8d-e0f35eefafa7 with Priority: HIGHEST for action port [ 581.171524] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-06ed5ca3-afe1-48b7-ad8d-e0f35eefafa7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.171622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06ed5ca3-afe1-48b7-ad8d-e0f35eefafa7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.171715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06ed5ca3-afe1-48b7-ad8d-e0f35eefafa7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.171971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06ed5ca3-afe1-48b7-ad8d-e0f35eefafa7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.172075] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06ed5ca3-afe1-48b7-ad8d-e0f35eefafa7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.251791] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf04703-55f3-479f-bb4c-a69bd221f98f in Status: SUCCESS [ 581.251791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.281463] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.281780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.283795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.283795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.283795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.283795] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.283795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.283795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.283795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.283795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.283795] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 already deleted. [ 581.283795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.440123] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11f84bbc-cc8c-4244-87ea-1493e7543f81: rpc.has_security_group_logging(os_id): False [ 581.458435] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.458784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.458784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.458948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.459980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.459980] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.459980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.459980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.459980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.459980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.459980] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.460299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.460299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.460376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.460464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.460650] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.460747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.460826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.460987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.462616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.462616] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 is going to be created. [ 581.506934] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: SUCCESS [ 581.507184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.530285] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.530285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.530285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.530285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.530285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.540310] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: IN_PROGRESS for 2s [ 581.675229] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06ed5ca3-afe1-48b7-ad8d-e0f35eefafa7 [ 581.675459] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.676427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.676427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.676427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.677466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.677756] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06ed5ca3-afe1-48b7-ad8d-e0f35eefafa7 already deleted. [ 581.677815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06ed5ca3-afe1-48b7-ad8d-e0f35eefafa7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.227382] env[62909]: INFO networking_nsxv3.common.synchronization [req-29faac43-3211-4bcb-822c-810599611adc req-232aa71c-3be3-4431-a6c0-c7f82b172967 service nova] Enqueued Resource ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 with Priority: HIGHEST for action security_group_rules [ 582.230129] env[62909]: INFO networking_nsxv3.common.synchronization [req-29faac43-3211-4bcb-822c-810599611adc req-232aa71c-3be3-4431-a6c0-c7f82b172967 service nova] Enqueued Resource ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 with Priority: HIGHEST for action security_group_members [ 582.230129] env[62909]: INFO networking_nsxv3.common.synchronization [req-29faac43-3211-4bcb-822c-810599611adc req-232aa71c-3be3-4431-a6c0-c7f82b172967 service nova] Enqueued Resource ID: 7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0 with Priority: HIGHEST for action port [ 582.230129] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 with Priority: HIGHEST for action security_group_rules [ 582.230129] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 with Priority: HIGHEST for action security_group_members [ 582.230129] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0 with Priority: HIGHEST for action port [ 582.230129] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2b03ac3-37c4-4e87-91a0-aaa294062815 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.230129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.230129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.230129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.230129] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2b03ac3-37c4-4e87-91a0-aaa294062815',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.233865] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2b03ac3-37c4-4e87-91a0-aaa294062815 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.234225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.234390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.234852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.238137] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.238137] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.238137] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.238137] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.238137] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.238137] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2b03ac3-37c4-4e87-91a0-aaa294062815',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.242068] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.242068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.242068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.242068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.242068] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.532511] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.533628] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.534447] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.534447] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.534940] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.535333] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.535333] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.536056] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.536056] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.539031] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 582.539031] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 582.539232] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 582.539614] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 582.539828] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 582.540449] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 582.541221] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 582.562724] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 582.562724] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 582.563260] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 582.563678] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.564107] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-3b909a06-3f47-4b08-8330-c3ac1c957a35 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.564385] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-3b909a06-3f47-4b08-8330-c3ac1c957a35" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.565045] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-3b909a06-3f47-4b08-8330-c3ac1c957a35" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.565045] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-3b909a06-3f47-4b08-8330-c3ac1c957a35" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.565045] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b909a06-3f47-4b08-8330-c3ac1c957a35',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.736219] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2b03ac3-37c4-4e87-91a0-aaa294062815 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.736219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.743956] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0 with status ACTIVE [ 582.747230] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.747230] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.747230] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.747230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.747230] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0 is going to be updated. [ 582.748694] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2b03ac3-37c4-4e87-91a0-aaa294062815',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.772751] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.772751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.772751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.772751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.772751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.772751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a9ccc3c-c2df-44ff-af19-7ce5b3048eb0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.068329] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.068589] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.068750] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.069080] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.069154] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.069293] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 3b909a06-3f47-4b08-8330-c3ac1c957a35 not found, creating... [ 583.069549] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.069706] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.069822] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.070074] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.070228] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.070527] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.070682] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.072258] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.073286] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.073286] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.073666] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 3b909a06-3f47-4b08-8330-c3ac1c957a35 is going to be created. [ 583.075441] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc in Status: SUCCESS [ 583.075876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.076175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.076452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.076673] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.076987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.076987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.077365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.077494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.077622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.077752] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73e434cf-a3e8-49df-8050-fa1d2489f7dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.097589] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.098224] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.098453] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.099109] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.099183] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.099449] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-3b909a06-3f47-4b08-8330-c3ac1c957a35" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.239873] env[62909]: INFO networking_nsxv3.common.synchronization [req-36650cb1-bde3-488e-a1fc-08cdddf6ea0b req-aab47f1a-9352-46b8-b5a2-481bc519442b tempest-MigrationsAdminTest-16747298 tempest-MigrationsAdminTest-16747298-project-member] Enqueued Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 583.241485] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 583.242378] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.242378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.242378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.242378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.242559] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.242671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.242738] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.242936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.243039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.243135] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.250659] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2b03ac3-37c4-4e87-91a0-aaa294062815',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.554780] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: SUCCESS [ 583.555019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.581840] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e434cf-a3e8-49df-8050-fa1d2489f7dc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.582070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.582142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.582356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.582585] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.582716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.583891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.583891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.583891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.583891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.583891] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e434cf-a3e8-49df-8050-fa1d2489f7dc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.584123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.584123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.585105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.585105] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.585105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.585105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.585105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.585105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.585374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.585374] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73e434cf-a3e8-49df-8050-fa1d2489f7dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.747254] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.747254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.747254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.747254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.747254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.747579] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.747579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.747579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.747690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.747720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.748170] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b already deleted. [ 583.748170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.756739] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.757661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.757661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.757873] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.758033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.758216] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 is going to be created. [ 583.786560] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.788038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.788688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.789040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.791164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.808293] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 in Status: UNINITIALIZED for 2s [ 584.009524] env[62909]: INFO networking_nsxv3.common.synchronization [None req-382ac7ae-17a5-4a1b-b420-4426c6cf3b1c None None] Enqueued Resource ID: 18b63724-512b-4694-961d-980048be39c1 with Priority: HIGHEST for action port [ 584.010179] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b63724-512b-4694-961d-980048be39c1 with Priority: HIGHEST for action port [ 584.011352] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-18b63724-512b-4694-961d-980048be39c1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.011352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18b63724-512b-4694-961d-980048be39c1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.011352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18b63724-512b-4694-961d-980048be39c1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.011352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18b63724-512b-4694-961d-980048be39c1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.011352] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18b63724-512b-4694-961d-980048be39c1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.088356] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73e434cf-a3e8-49df-8050-fa1d2489f7dc: rpc.has_security_group_logging(os_id): False [ 584.118333] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.118665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.123447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.123854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.123968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.124226] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.124355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.124512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.124643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.124680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.124910] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.125026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.125079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.125321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.125420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.125639] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.125745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.125816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.126015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.126090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.126207] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc is going to be created. [ 584.206899] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.208108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.208288] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.208775] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.209336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.222600] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc in Status: IN_PROGRESS for 2s [ 584.515057] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18b63724-512b-4694-961d-980048be39c1 [ 584.515057] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.515057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.515057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.515604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.515604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.516830] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18b63724-512b-4694-961d-980048be39c1 already deleted. [ 584.516830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18b63724-512b-4694-961d-980048be39c1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.804101] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.804101] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.804101] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.804101] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.804101] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.804101] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.804101] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.804101] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.804101] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.804101] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 584.804101] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 584.804101] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 584.804101] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 584.804571] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 584.804571] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 584.804571] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 584.830923] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 584.831087] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 584.831285] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 584.831406] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.832801] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-ae6db457-8035-4a28-bf52-7113144cfe11 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.832801] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-ae6db457-8035-4a28-bf52-7113144cfe11" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.832801] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-ae6db457-8035-4a28-bf52-7113144cfe11" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.832801] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-ae6db457-8035-4a28-bf52-7113144cfe11" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.832801] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae6db457-8035-4a28-bf52-7113144cfe11',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.276910] env[62909]: INFO networking_nsxv3.common.synchronization [req-e2943893-8d8d-460c-b5e7-1c2185af2992 req-2b6d44f0-09a3-4dd4-bd9d-86ce542d2e11 service nova] Enqueued Resource ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 with Priority: HIGHEST for action security_group_rules [ 585.276910] env[62909]: INFO networking_nsxv3.common.synchronization [req-e2943893-8d8d-460c-b5e7-1c2185af2992 req-2b6d44f0-09a3-4dd4-bd9d-86ce542d2e11 service nova] Enqueued Resource ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 with Priority: HIGHEST for action security_group_members [ 585.276910] env[62909]: INFO networking_nsxv3.common.synchronization [req-e2943893-8d8d-460c-b5e7-1c2185af2992 req-2b6d44f0-09a3-4dd4-bd9d-86ce542d2e11 service nova] Enqueued Resource ID: 3b909a06-3f47-4b08-8330-c3ac1c957a35 with Priority: HIGHEST for action port [ 585.276910] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 with Priority: HIGHEST for action security_group_rules [ 585.276910] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 with Priority: HIGHEST for action security_group_members [ 585.276910] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b909a06-3f47-4b08-8330-c3ac1c957a35 with Priority: HIGHEST for action port [ 585.278019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f700c8-ea6e-4561-84ab-c40836ff4286 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.278610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.278610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.278760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.278903] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f700c8-ea6e-4561-84ab-c40836ff4286',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.279878] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f700c8-ea6e-4561-84ab-c40836ff4286 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.281162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.281162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.281162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.281162] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.281162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.281162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.281393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.282039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.282039] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f700c8-ea6e-4561-84ab-c40836ff4286',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.287122] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b909a06-3f47-4b08-8330-c3ac1c957a35 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.287122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b909a06-3f47-4b08-8330-c3ac1c957a35" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.287122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b909a06-3f47-4b08-8330-c3ac1c957a35" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.287122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b909a06-3f47-4b08-8330-c3ac1c957a35" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.287386] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b909a06-3f47-4b08-8330-c3ac1c957a35',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.338811] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.338906] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.339055] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.339326] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.342448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.342448] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port ae6db457-8035-4a28-bf52-7113144cfe11 not found, creating... [ 585.342448] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.342448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.342448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.342448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.342448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.342448] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.342448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.342448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.342892] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.342892] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.342892] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: ae6db457-8035-4a28-bf52-7113144cfe11 is going to be created. [ 585.370204] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.370204] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.370204] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.374348] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.374348] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.374348] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-ae6db457-8035-4a28-bf52-7113144cfe11" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.710999] env[62909]: INFO networking_nsxv3.common.synchronization [None req-4ae826fa-6cab-4c29-bed9-f99f3447ea8c None None] Enqueued Resource ID: 46a35b70-6798-494d-b111-0d70bec1e00a with Priority: HIGHEST for action port [ 585.711699] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a35b70-6798-494d-b111-0d70bec1e00a with Priority: HIGHEST for action port [ 585.713398] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-46a35b70-6798-494d-b111-0d70bec1e00a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.713643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46a35b70-6798-494d-b111-0d70bec1e00a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.713643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46a35b70-6798-494d-b111-0d70bec1e00a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.713904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46a35b70-6798-494d-b111-0d70bec1e00a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.713978] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a35b70-6798-494d-b111-0d70bec1e00a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.790653] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f700c8-ea6e-4561-84ab-c40836ff4286 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.790653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.790653] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f700c8-ea6e-4561-84ab-c40836ff4286',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.790653] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b909a06-3f47-4b08-8330-c3ac1c957a35 with status ACTIVE [ 585.790904] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.790960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.790999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.791245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.791353] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.791511] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.791604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.791660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.791806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.791881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.792375] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.792482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.792519] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.794161] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.794161] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.794161] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b909a06-3f47-4b08-8330-c3ac1c957a35 is going to be updated. [ 585.816737] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.817733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.817733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.817733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.817733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.818141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b909a06-3f47-4b08-8330-c3ac1c957a35" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.818997] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 in Status: SUCCESS [ 585.819555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.819706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.819981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.820191] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.820303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.820367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.820759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.820975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.821082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.821226] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2b03ac3-37c4-4e87-91a0-aaa294062815',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.217516] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46a35b70-6798-494d-b111-0d70bec1e00a [ 586.223036] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.223036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.223036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.223036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.223036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.223036] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46a35b70-6798-494d-b111-0d70bec1e00a already deleted. [ 586.223036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46a35b70-6798-494d-b111-0d70bec1e00a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.242684] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc in Status: SUCCESS [ 586.242684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.295929] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f700c8-ea6e-4561-84ab-c40836ff4286',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.324319] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2b03ac3-37c4-4e87-91a0-aaa294062815 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.324574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.324574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.324763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.324969] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.325113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.325174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.325371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.325573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.325748] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.325865] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2b03ac3-37c4-4e87-91a0-aaa294062815 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.326070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.326483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.326483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.326483] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.328538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.328538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.328538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.328538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.328538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.328538] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2b03ac3-37c4-4e87-91a0-aaa294062815',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.798130] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.798580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.798580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.800716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.800716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.800716] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 is going to be created. [ 586.830306] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.830306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.830306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.830306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.830932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.832558] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2b03ac3-37c4-4e87-91a0-aaa294062815: rpc.has_security_group_logging(os_id): False [ 586.846298] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 in Status: UNINITIALIZED for 2s [ 586.854477] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.854477] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.854477] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.854477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.855725] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.855725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.855725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.855725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.855725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.858650] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 is going to be created. [ 586.938947] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.938947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.938947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.938947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.938947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.952288] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 in Status: IN_PROGRESS for 2s [ 587.748061] env[62909]: INFO networking_nsxv3.common.synchronization [req-36650cb1-bde3-488e-a1fc-08cdddf6ea0b req-4302eaa3-4049-423a-a1f5-a780377e3a7d service nova] Enqueued Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_rules [ 587.748061] env[62909]: INFO networking_nsxv3.common.synchronization [req-36650cb1-bde3-488e-a1fc-08cdddf6ea0b req-4302eaa3-4049-423a-a1f5-a780377e3a7d service nova] Enqueued Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 587.748331] env[62909]: INFO networking_nsxv3.common.synchronization [req-36650cb1-bde3-488e-a1fc-08cdddf6ea0b req-4302eaa3-4049-423a-a1f5-a780377e3a7d service nova] Enqueued Resource ID: ae6db457-8035-4a28-bf52-7113144cfe11 with Priority: HIGHEST for action port [ 587.748331] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_rules [ 587.748451] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 587.748535] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6db457-8035-4a28-bf52-7113144cfe11 with Priority: HIGHEST for action port [ 587.751066] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.751066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.751066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.751066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.751272] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.752351] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.752649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.752649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.752806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.752978] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.753706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.753706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.753706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.753706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.753706] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.754641] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae6db457-8035-4a28-bf52-7113144cfe11 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.754641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae6db457-8035-4a28-bf52-7113144cfe11" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.754641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae6db457-8035-4a28-bf52-7113144cfe11" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.754795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae6db457-8035-4a28-bf52-7113144cfe11" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.754827] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae6db457-8035-4a28-bf52-7113144cfe11',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.833405] env[62909]: INFO networking_nsxv3.common.synchronization [None req-8298ed3a-20f9-489f-b55d-e57ab24711a5 None None] Enqueued Resource ID: 84d7a5f1-16ad-4588-893e-742d79bb262f with Priority: HIGHEST for action port [ 587.833982] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84d7a5f1-16ad-4588-893e-742d79bb262f with Priority: HIGHEST for action port [ 587.834235] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-84d7a5f1-16ad-4588-893e-742d79bb262f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.834702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84d7a5f1-16ad-4588-893e-742d79bb262f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.834702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84d7a5f1-16ad-4588-893e-742d79bb262f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.834702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84d7a5f1-16ad-4588-893e-742d79bb262f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.834702] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84d7a5f1-16ad-4588-893e-742d79bb262f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.874626] env[62909]: INFO networking_nsxv3.common.synchronization [None req-67903724-5778-4b9b-92cc-46a23e30c897 None None] Enqueued Resource ID: 4f3c8e56-02f0-4111-aef8-aeba8e2e3ed8 with Priority: HIGHEST for action port [ 587.874626] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3c8e56-02f0-4111-aef8-aeba8e2e3ed8 with Priority: HIGHEST for action port [ 587.874874] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f3c8e56-02f0-4111-aef8-aeba8e2e3ed8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.875171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f3c8e56-02f0-4111-aef8-aeba8e2e3ed8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.875171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f3c8e56-02f0-4111-aef8-aeba8e2e3ed8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.875354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f3c8e56-02f0-4111-aef8-aeba8e2e3ed8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.875420] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f3c8e56-02f0-4111-aef8-aeba8e2e3ed8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.257792] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.259811] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.259811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.259811] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae6db457-8035-4a28-bf52-7113144cfe11 with status ACTIVE [ 588.260319] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.266548] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.266548] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.266548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.266548] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae6db457-8035-4a28-bf52-7113144cfe11 is going to be updated. [ 588.298233] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.298411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.298479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.298801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.298947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.299168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae6db457-8035-4a28-bf52-7113144cfe11" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.343022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84d7a5f1-16ad-4588-893e-742d79bb262f [ 588.343022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.343022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.343022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.343022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.343463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.343463] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84d7a5f1-16ad-4588-893e-742d79bb262f already deleted. [ 588.343463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84d7a5f1-16ad-4588-893e-742d79bb262f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.344419] env[62909]: INFO networking_nsxv3.common.synchronization [req-fbb15ce3-d1b4-4098-99ad-7e0003223c68 req-9931754f-811e-4307-a876-7ab2ac35fdd1 tempest-VolumesAdminNegativeTest-328242297 tempest-VolumesAdminNegativeTest-328242297-project-member] Enqueued Resource ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca with Priority: HIGHEST for action security_group_members [ 588.345149] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca with Priority: HIGHEST for action security_group_members [ 588.345513] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-14d66eff-4d06-4f86-92c4-66d09f1004ca taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.345633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.345696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.345956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.346128] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.346263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.346895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.347140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.347282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.347425] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14d66eff-4d06-4f86-92c4-66d09f1004ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.381812] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f3c8e56-02f0-4111-aef8-aeba8e2e3ed8 [ 588.382131] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.382308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.382391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.382633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.382747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.382876] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f3c8e56-02f0-4111-aef8-aeba8e2e3ed8 already deleted. [ 588.382960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f3c8e56-02f0-4111-aef8-aeba8e2e3ed8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.771348] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.852150] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.852781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.854226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.854226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.854226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.854226] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.854226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.854226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.854226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.854226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.854226] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca already deleted. [ 588.854226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.856963] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 in Status: SUCCESS [ 588.858729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.858729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.858729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.858729] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.858729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.858729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.858956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.858956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.858956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.859086] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69f700c8-ea6e-4561-84ab-c40836ff4286',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.041806] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 in Status: SUCCESS [ 589.042014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.279444] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.279444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.279444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.279444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.279444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.279444] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b is going to be created. [ 589.311123] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.312668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.312668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.312668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.312668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.326520] env[62909]: INFO networking_nsxv3.common.synchronization [None req-85ada3b0-a061-4cc3-94e9-8238f47b73fd None None] Enqueued Resource ID: 0237d58d-2686-4713-b397-2b88cde5d4fb with Priority: HIGHEST for action port [ 589.329455] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: UNINITIALIZED for 2s [ 589.331018] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0237d58d-2686-4713-b397-2b88cde5d4fb with Priority: HIGHEST for action port [ 589.331018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-0237d58d-2686-4713-b397-2b88cde5d4fb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.331018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0237d58d-2686-4713-b397-2b88cde5d4fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.331018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0237d58d-2686-4713-b397-2b88cde5d4fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.331018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0237d58d-2686-4713-b397-2b88cde5d4fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.331326] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0237d58d-2686-4713-b397-2b88cde5d4fb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.364861] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f700c8-ea6e-4561-84ab-c40836ff4286 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.365516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.365593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.365828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.366062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.366641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.366713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.367050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.367189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.367420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.367615] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f700c8-ea6e-4561-84ab-c40836ff4286 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.367727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.367781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.368071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.368365] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.368467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.368527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.368674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.368758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.368841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.368928] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69f700c8-ea6e-4561-84ab-c40836ff4286',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.593543] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-953 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.594682] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-953" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.595537] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-953" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.596214] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-953" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.599429] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.599429] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.599429] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.599429] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.599429] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.599429] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 589.599429] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.599429] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.599429] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.599429] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 589.599429] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.602066] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.631061] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.631061] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 589.631061] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.631061] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-953" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.631061] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-16cf2714-36d7-443b-a820-1fe738d54164 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.631061] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-16cf2714-36d7-443b-a820-1fe738d54164" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.631061] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-16cf2714-36d7-443b-a820-1fe738d54164" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.631061] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-16cf2714-36d7-443b-a820-1fe738d54164" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.631061] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16cf2714-36d7-443b-a820-1fe738d54164',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.754028] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b766353e-d2b8-4cac-8874-1fff932ee2f1 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_rules [ 589.754028] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_rules [ 589.754028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b723f584-c976-4351-bfcd-6ca761e670dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.754028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.754028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.754737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.755356] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.833849] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0237d58d-2686-4713-b397-2b88cde5d4fb [ 589.835145] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.835145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.835145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.835145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.835145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.835145] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0237d58d-2686-4713-b397-2b88cde5d4fb already deleted. [ 589.835145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0237d58d-2686-4713-b397-2b88cde5d4fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.870875] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69f700c8-ea6e-4561-84ab-c40836ff4286: rpc.has_security_group_logging(os_id): False [ 589.893315] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.893457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.893543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.893756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.893838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.894065] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.894211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.894278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.894456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.894566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.894780] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.894914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.894949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.895087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.895153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.899202] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.899369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.899437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.899625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.899693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.899800] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 is going to be created. [ 589.984086] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.984086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.984086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.984086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.984086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.998169] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 in Status: IN_PROGRESS for 2s [ 590.133583] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.133855] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.134050] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.135082] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.135082] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.135082] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 16cf2714-36d7-443b-a820-1fe738d54164 not found, creating... [ 590.135082] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.135355] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.135355] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.135796] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.135796] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.138543] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.138543] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.138716] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.138864] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.139033] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.139248] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 16cf2714-36d7-443b-a820-1fe738d54164 is going to be created. [ 590.163019] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.164305] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.165047] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.165047] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.165047] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.166155] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-16cf2714-36d7-443b-a820-1fe738d54164" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.224753] env[62909]: INFO networking_nsxv3.common.synchronization [None req-2c3a7328-5fbf-4e40-a130-a3bc6a7fb75d tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_rules [ 590.225342] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_rules [ 590.225662] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b723f584-c976-4351-bfcd-6ca761e670dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.225767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.298689] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.301813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.302048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.302477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.302656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.302948] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b723f584-c976-4351-bfcd-6ca761e670dd already deleted. [ 590.303041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.306060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.306060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.306060] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.508838] env[62909]: INFO networking_nsxv3.common.synchronization [req-9abe73e5-c7f3-43b0-a8b0-7fc6a004fda5 req-8e469fc0-5f9c-4504-91cb-69d242e42c1e tempest-VolumesAssistedSnapshotsTest-1541736566 tempest-VolumesAssistedSnapshotsTest-1541736566-project-member] Enqueued Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_members [ 590.509621] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_members [ 590.509985] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2821bc4-3047-4598-bd51-10cd2a5b1137 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.510098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.510164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.510535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.510660] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.510782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.510782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.511029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.511029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.511183] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.724639] env[62909]: INFO networking_nsxv3.common.synchronization [None req-5e8ca47d-e76e-42f5-9a9c-9785b83d9b4a None None] Enqueued Resource ID: ffbac96f-699f-4350-bfb6-357a3e2240c5 with Priority: HIGHEST for action port [ 590.725595] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffbac96f-699f-4350-bfb6-357a3e2240c5 with Priority: HIGHEST for action port [ 590.727234] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffbac96f-699f-4350-bfb6-357a3e2240c5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.727457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffbac96f-699f-4350-bfb6-357a3e2240c5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.727622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffbac96f-699f-4350-bfb6-357a3e2240c5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.727931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffbac96f-699f-4350-bfb6-357a3e2240c5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.727931] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffbac96f-699f-4350-bfb6-357a3e2240c5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.832863] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.833012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.833131] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.833310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.833403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.833497] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b723f584-c976-4351-bfcd-6ca761e670dd already deleted. [ 590.833579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.014410] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.014410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.014410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.014410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.014410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.014410] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.014410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.015113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.015113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.015113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.015263] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 already deleted. [ 591.015263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.230694] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffbac96f-699f-4350-bfb6-357a3e2240c5 [ 591.230959] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.231115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.231174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.231387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.231437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.231514] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffbac96f-699f-4350-bfb6-357a3e2240c5 already deleted. [ 591.231620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffbac96f-699f-4350-bfb6-357a3e2240c5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.341116] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: SUCCESS [ 591.341352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.341556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.342031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.342031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.346036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.346036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.346036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.346036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.346036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.346036] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.673015] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b576a41a-1118-4603-897c-01db911c223a None None] Enqueued Resource ID: 45cd2418-501f-48f6-a631-80544a1030f1 with Priority: HIGHEST for action port [ 591.673882] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cd2418-501f-48f6-a631-80544a1030f1 with Priority: HIGHEST for action port [ 591.674324] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-45cd2418-501f-48f6-a631-80544a1030f1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.674414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45cd2418-501f-48f6-a631-80544a1030f1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.674454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45cd2418-501f-48f6-a631-80544a1030f1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.674702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45cd2418-501f-48f6-a631-80544a1030f1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.674782] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45cd2418-501f-48f6-a631-80544a1030f1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.827330] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.827498] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-885" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.827855] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-885" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.829125] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-885" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.829548] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.829779] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.829978] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.830421] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.830611] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.830752] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 591.830919] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.831550] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.831550] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.831550] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 591.831550] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.831779] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.848963] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.848963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.848963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.848963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.849177] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.849232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.850255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.850255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.850255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.850255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.850255] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.850255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.850255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.850255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.850255] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.850856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.850856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.850856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.850856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.850856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.850856] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.855193] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.855344] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 591.855479] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.855640] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-885" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.855937] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-a37b3d57-45a7-4167-970b-4734a54661f8 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.856151] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-a37b3d57-45a7-4167-970b-4734a54661f8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.856270] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-a37b3d57-45a7-4167-970b-4734a54661f8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.856565] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-a37b3d57-45a7-4167-970b-4734a54661f8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.856798] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a37b3d57-45a7-4167-970b-4734a54661f8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.014702] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 in Status: SUCCESS [ 592.015387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.177776] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45cd2418-501f-48f6-a631-80544a1030f1 [ 592.178152] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.178436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.178436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.178591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.178652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.178758] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45cd2418-501f-48f6-a631-80544a1030f1 already deleted. [ 592.180138] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45cd2418-501f-48f6-a631-80544a1030f1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.269498] env[62909]: INFO networking_nsxv3.common.synchronization [req-fbb15ce3-d1b4-4098-99ad-7e0003223c68 req-072b3580-01d7-429f-9cc5-99e7ad191846 service nova] Enqueued Resource ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca with Priority: HIGHEST for action security_group_rules [ 592.269603] env[62909]: INFO networking_nsxv3.common.synchronization [req-fbb15ce3-d1b4-4098-99ad-7e0003223c68 req-072b3580-01d7-429f-9cc5-99e7ad191846 service nova] Enqueued Resource ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca with Priority: HIGHEST for action security_group_members [ 592.269741] env[62909]: INFO networking_nsxv3.common.synchronization [req-fbb15ce3-d1b4-4098-99ad-7e0003223c68 req-072b3580-01d7-429f-9cc5-99e7ad191846 service nova] Enqueued Resource ID: 16cf2714-36d7-443b-a820-1fe738d54164 with Priority: HIGHEST for action port [ 592.273384] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca with Priority: HIGHEST for action security_group_rules [ 592.273384] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca with Priority: HIGHEST for action security_group_members [ 592.273384] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16cf2714-36d7-443b-a820-1fe738d54164 with Priority: HIGHEST for action port [ 592.273384] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14d66eff-4d06-4f86-92c4-66d09f1004ca taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.273384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.273384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.273384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.273687] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14d66eff-4d06-4f86-92c4-66d09f1004ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.277372] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-14d66eff-4d06-4f86-92c4-66d09f1004ca taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.277372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.277372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.277372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.277372] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.277941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.277941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.277941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.277941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.279850] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14d66eff-4d06-4f86-92c4-66d09f1004ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.283062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-16cf2714-36d7-443b-a820-1fe738d54164 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.283290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16cf2714-36d7-443b-a820-1fe738d54164" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.283372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16cf2714-36d7-443b-a820-1fe738d54164" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.283913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16cf2714-36d7-443b-a820-1fe738d54164" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.284235] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16cf2714-36d7-443b-a820-1fe738d54164',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.353897] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24030e1e-897b-4a91-9a5a-7c9e92186e4b: rpc.has_security_group_logging(os_id): False [ 592.363705] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.363813] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.363945] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.364260] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.364414] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.364558] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port a37b3d57-45a7-4167-970b-4734a54661f8 not found, creating... [ 592.364878] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.365074] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.365198] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.365493] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.365663] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.365972] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.367453] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.367581] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.367839] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.367978] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.368181] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: a37b3d57-45a7-4167-970b-4734a54661f8 is going to be created. [ 592.385460] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.385821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.385821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.385821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.385930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.386494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.386494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.386494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.386494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.386494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.386860] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.386860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.386860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.387094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.387094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.387197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.387291] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.387355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.387481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.387556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.387641] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b is going to be created. [ 592.401038] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.401038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.401038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.402022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.402022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.402022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-a37b3d57-45a7-4167-970b-4734a54661f8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.496033] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.496033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.496033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.496284] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.496489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.521690] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: IN_PROGRESS for 2s [ 592.792618] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-14d66eff-4d06-4f86-92c4-66d09f1004ca taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.792618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.792618] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14d66eff-4d06-4f86-92c4-66d09f1004ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.792618] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16cf2714-36d7-443b-a820-1fe738d54164 with status ACTIVE [ 592.792618] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.792618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.792618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.792618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.792618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.792618] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.792618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.793495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.793495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.793495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.793495] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.793495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.793495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.793495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.793495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.793753] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16cf2714-36d7-443b-a820-1fe738d54164 is going to be updated. [ 592.817873] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.818062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.818147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.818354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.818504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.818659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16cf2714-36d7-443b-a820-1fe738d54164" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.855534] env[62909]: INFO networking_nsxv3.common.synchronization [None req-2ce6f7e0-410c-46e9-8bf6-72deefdef82e None None] Enqueued Resource ID: 54f7cc1e-40b7-403b-bd53-cee5523d3c92 with Priority: HIGHEST for action port [ 592.855803] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f7cc1e-40b7-403b-bd53-cee5523d3c92 with Priority: HIGHEST for action port [ 592.857714] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-54f7cc1e-40b7-403b-bd53-cee5523d3c92 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.858960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54f7cc1e-40b7-403b-bd53-cee5523d3c92" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.859567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54f7cc1e-40b7-403b-bd53-cee5523d3c92" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.859567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54f7cc1e-40b7-403b-bd53-cee5523d3c92" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.859695] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f7cc1e-40b7-403b-bd53-cee5523d3c92',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.300278] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14d66eff-4d06-4f86-92c4-66d09f1004ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.364541] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54f7cc1e-40b7-403b-bd53-cee5523d3c92 [ 593.364541] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.364541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.364541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.364541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.364541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.364541] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54f7cc1e-40b7-403b-bd53-cee5523d3c92 already deleted. [ 593.364541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54f7cc1e-40b7-403b-bd53-cee5523d3c92" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.524768] env[62909]: INFO networking_nsxv3.common.synchronization [None req-96d687eb-2dcb-4484-a115-8b6d648cf9d8 None None] Enqueued Resource ID: cbba8131-42ef-4aa5-b0a4-23afdde74d72 with Priority: HIGHEST for action port [ 593.528383] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbba8131-42ef-4aa5-b0a4-23afdde74d72 with Priority: HIGHEST for action port [ 593.529422] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbba8131-42ef-4aa5-b0a4-23afdde74d72 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.529422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbba8131-42ef-4aa5-b0a4-23afdde74d72" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.529422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbba8131-42ef-4aa5-b0a4-23afdde74d72" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.530208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbba8131-42ef-4aa5-b0a4-23afdde74d72" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.530689] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbba8131-42ef-4aa5-b0a4-23afdde74d72',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.804343] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.804343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.804343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.804534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.804720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.804847] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca is going to be created. [ 593.842620] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.844207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.846938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.846938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.846938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.865010] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca in Status: UNINITIALIZED for 2s [ 594.033402] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbba8131-42ef-4aa5-b0a4-23afdde74d72 [ 594.033853] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.034164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.034426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.034788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.034980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.035181] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbba8131-42ef-4aa5-b0a4-23afdde74d72 already deleted. [ 594.035352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbba8131-42ef-4aa5-b0a4-23afdde74d72" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.248584] env[62909]: INFO networking_nsxv3.common.synchronization [req-216313be-6f1a-4231-b1f5-6119fbf2b400 req-a27a9e24-15f0-4b27-8d9a-c6fdc2069c48 tempest-ServersWithSpecificFlavorTestJSON-184799251 tempest-ServersWithSpecificFlavorTestJSON-184799251-project-member] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 594.250816] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 594.250816] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.250816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.250816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.250816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.250816] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.250816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.250816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.250816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.250816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.250816] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.399487] env[62909]: INFO networking_nsxv3.common.synchronization [req-9abe73e5-c7f3-43b0-a8b0-7fc6a004fda5 req-71728cb7-af8b-4be6-8d94-e353fb5eab4c service nova] Enqueued Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_rules [ 594.399487] env[62909]: INFO networking_nsxv3.common.synchronization [req-9abe73e5-c7f3-43b0-a8b0-7fc6a004fda5 req-71728cb7-af8b-4be6-8d94-e353fb5eab4c service nova] Enqueued Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_members [ 594.399487] env[62909]: INFO networking_nsxv3.common.synchronization [req-9abe73e5-c7f3-43b0-a8b0-7fc6a004fda5 req-71728cb7-af8b-4be6-8d94-e353fb5eab4c service nova] Enqueued Resource ID: a37b3d57-45a7-4167-970b-4734a54661f8 with Priority: HIGHEST for action port [ 594.400201] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_rules [ 594.400201] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_members [ 594.400947] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a37b3d57-45a7-4167-970b-4734a54661f8 with Priority: HIGHEST for action port [ 594.402668] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2821bc4-3047-4598-bd51-10cd2a5b1137 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.402668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.402668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.402668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.402668] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.403084] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2821bc4-3047-4598-bd51-10cd2a5b1137 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.403084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.403084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.403084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.403311] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.403311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.403427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.403484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.403602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.403656] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.405827] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-a37b3d57-45a7-4167-970b-4734a54661f8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.405947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a37b3d57-45a7-4167-970b-4734a54661f8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.406022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a37b3d57-45a7-4167-970b-4734a54661f8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.406233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a37b3d57-45a7-4167-970b-4734a54661f8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.406322] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a37b3d57-45a7-4167-970b-4734a54661f8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.540289] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: SUCCESS [ 594.540289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.757134] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.758692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.758692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.758692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.758692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.759564] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.760565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.760565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.760565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.760565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.760565] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 already deleted. [ 594.760565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.907922] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2821bc4-3047-4598-bd51-10cd2a5b1137 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.908096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.908276] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.909163] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a37b3d57-45a7-4167-970b-4734a54661f8 with status ACTIVE [ 594.909336] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.911303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.911395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.914801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.914801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.914801] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.914801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.914801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.914801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.916090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.916090] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.916090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.916090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.916090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.916090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.916090] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a37b3d57-45a7-4167-970b-4734a54661f8 is going to be updated. [ 594.946027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.946134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.946205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.946919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.947078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.947257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a37b3d57-45a7-4167-970b-4734a54661f8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.327039] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.327039] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-714" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.327039] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-714" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.327995] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-714" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.331984] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.331984] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.331984] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.331984] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.331984] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.331984] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.331984] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.331984] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.331984] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.331984] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.331984] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.331984] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.360022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.360022] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 595.360022] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.360022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-714" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.360022] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-cf87f855-3a4c-43d5-a06f-db1eb5eec958 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.360022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-cf87f855-3a4c-43d5-a06f-db1eb5eec958" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.360022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-cf87f855-3a4c-43d5-a06f-db1eb5eec958" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.360022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-cf87f855-3a4c-43d5-a06f-db1eb5eec958" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.360747] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf87f855-3a4c-43d5-a06f-db1eb5eec958',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.417684] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.867602] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.867861] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.868335] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.868710] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.868869] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.869040] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port cf87f855-3a4c-43d5-a06f-db1eb5eec958 not found, creating... [ 595.869311] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.869469] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.869581] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.869813] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.869944] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.870839] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.871094] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.871274] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.871542] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.871726] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.872104] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: cf87f855-3a4c-43d5-a06f-db1eb5eec958 is going to be created. [ 595.887817] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca in Status: SUCCESS [ 595.888045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.888256] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.888479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.888661] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.888781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.888843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.888998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.889116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.889219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.889310] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14d66eff-4d06-4f86-92c4-66d09f1004ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.895927] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.896293] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.896512] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.896798] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.897310] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.897691] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-cf87f855-3a4c-43d5-a06f-db1eb5eec958" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.926742] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.926742] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.926902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.927904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.927904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.927904] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 is going to be created. [ 595.975196] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.975458] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.975821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.976168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.976467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.990272] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 in Status: UNINITIALIZED for 2s [ 596.122063] env[62909]: INFO networking_nsxv3.common.synchronization [None req-d4ff1ecf-2450-4d1a-8bd3-d180cdd8c348 None None] Enqueued Resource ID: 52b14658-dcae-4104-98b4-94966eb2549a with Priority: HIGHEST for action port [ 596.122932] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52b14658-dcae-4104-98b4-94966eb2549a with Priority: HIGHEST for action port [ 596.123277] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-52b14658-dcae-4104-98b4-94966eb2549a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.123406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52b14658-dcae-4104-98b4-94966eb2549a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.123471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52b14658-dcae-4104-98b4-94966eb2549a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.124803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52b14658-dcae-4104-98b4-94966eb2549a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.124955] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52b14658-dcae-4104-98b4-94966eb2549a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.395376] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-14d66eff-4d06-4f86-92c4-66d09f1004ca taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.395376] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.395376] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-14d66eff-4d06-4f86-92c4-66d09f1004ca taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.395376] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.395376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.396214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.397709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.397709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.397809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.397869] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14d66eff-4d06-4f86-92c4-66d09f1004ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.469070] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b5e9cf7d-3fe0-4258-b509-bd85a500aa1d None None] Enqueued Resource ID: c1f6de21-db88-4a11-8fce-a75ca46b270c with Priority: HIGHEST for action port [ 596.469070] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1f6de21-db88-4a11-8fce-a75ca46b270c with Priority: HIGHEST for action port [ 596.469070] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1f6de21-db88-4a11-8fce-a75ca46b270c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.469070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1f6de21-db88-4a11-8fce-a75ca46b270c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.469070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1f6de21-db88-4a11-8fce-a75ca46b270c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.471300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1f6de21-db88-4a11-8fce-a75ca46b270c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.471634] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1f6de21-db88-4a11-8fce-a75ca46b270c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.627037] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52b14658-dcae-4104-98b4-94966eb2549a [ 596.627552] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.627729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.627800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.628058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.628244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.628349] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52b14658-dcae-4104-98b4-94966eb2549a already deleted. [ 596.628535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52b14658-dcae-4104-98b4-94966eb2549a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.900773] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14d66eff-4d06-4f86-92c4-66d09f1004ca: rpc.has_security_group_logging(os_id): False [ 596.921073] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.921257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.921361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.921680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.921852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.922171] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.922326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.922421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.922675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.922796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.923233] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.923420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.923715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.923776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.923859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.924155] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.924368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.924442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.924611] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.924730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.924854] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca is going to be created. [ 596.974263] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1f6de21-db88-4a11-8fce-a75ca46b270c [ 596.974533] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.974679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.974751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.975139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.975434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.975434] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1f6de21-db88-4a11-8fce-a75ca46b270c already deleted. [ 596.975595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1f6de21-db88-4a11-8fce-a75ca46b270c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.987687] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.987843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.988034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.990272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.990272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.001207] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca in Status: IN_PROGRESS for 2s [ 597.549383] env[62909]: INFO networking_nsxv3.common.synchronization [req-216313be-6f1a-4231-b1f5-6119fbf2b400 req-2e106829-8c95-4641-b6c0-6191503dbf6b service nova] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_rules [ 597.549748] env[62909]: INFO networking_nsxv3.common.synchronization [req-216313be-6f1a-4231-b1f5-6119fbf2b400 req-2e106829-8c95-4641-b6c0-6191503dbf6b service nova] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 597.549748] env[62909]: INFO networking_nsxv3.common.synchronization [req-216313be-6f1a-4231-b1f5-6119fbf2b400 req-2e106829-8c95-4641-b6c0-6191503dbf6b service nova] Enqueued Resource ID: cf87f855-3a4c-43d5-a06f-db1eb5eec958 with Priority: HIGHEST for action port [ 597.550553] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_rules [ 597.550689] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 597.550817] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf87f855-3a4c-43d5-a06f-db1eb5eec958 with Priority: HIGHEST for action port [ 597.551115] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.551272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.551373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.551576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.551692] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.555371] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.555827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.555827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.556671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.559518] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.559518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.559518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.559518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.559518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.559518] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.559518] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf87f855-3a4c-43d5-a06f-db1eb5eec958 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.559518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf87f855-3a4c-43d5-a06f-db1eb5eec958" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.559518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf87f855-3a4c-43d5-a06f-db1eb5eec958" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.559518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf87f855-3a4c-43d5-a06f-db1eb5eec958" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.559518] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf87f855-3a4c-43d5-a06f-db1eb5eec958',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.004823] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 in Status: SUCCESS [ 598.004823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.004823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.004823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.004823] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.004823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.004823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.004823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.005136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.005136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.005136] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.061337] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.062570] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.062821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.062974] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf87f855-3a4c-43d5-a06f-db1eb5eec958 with status ACTIVE [ 598.063234] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.063390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.063495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.063785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.065232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.065434] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.065530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.065588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.066904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.066904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.066904] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.066904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.066904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.066904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.066904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.067317] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf87f855-3a4c-43d5-a06f-db1eb5eec958 is going to be updated. [ 598.093754] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.093942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.094025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.094234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.094366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.094523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf87f855-3a4c-43d5-a06f-db1eb5eec958" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.191767] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e59bbefe-3043-48bd-bb77-fff1da7755b1 None None] Enqueued Resource ID: 3102ba9b-4eea-41ee-997c-a4ebb2ac9c97 with Priority: HIGHEST for action port [ 598.192359] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3102ba9b-4eea-41ee-997c-a4ebb2ac9c97 with Priority: HIGHEST for action port [ 598.192665] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-3102ba9b-4eea-41ee-997c-a4ebb2ac9c97 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.192782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3102ba9b-4eea-41ee-997c-a4ebb2ac9c97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.192846] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3102ba9b-4eea-41ee-997c-a4ebb2ac9c97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.193172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3102ba9b-4eea-41ee-997c-a4ebb2ac9c97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.193260] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3102ba9b-4eea-41ee-997c-a4ebb2ac9c97',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.307579] env[62909]: INFO networking_nsxv3.common.synchronization [None req-dce51676-28ab-4f1a-8e40-e948d8e9e597 None None] Enqueued Resource ID: c8ce285a-66b4-41d5-aa51-4bbc593d7d42 with Priority: HIGHEST for action port [ 598.307579] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ce285a-66b4-41d5-aa51-4bbc593d7d42 with Priority: HIGHEST for action port [ 598.307579] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8ce285a-66b4-41d5-aa51-4bbc593d7d42 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.307579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8ce285a-66b4-41d5-aa51-4bbc593d7d42" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.307579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8ce285a-66b4-41d5-aa51-4bbc593d7d42" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.308688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8ce285a-66b4-41d5-aa51-4bbc593d7d42" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.308688] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8ce285a-66b4-41d5-aa51-4bbc593d7d42',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.508626] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.555310] env[62909]: INFO networking_nsxv3.common.synchronization [None req-209dec1c-5b9d-4629-83f2-39c92f7d55ce None None] Enqueued Resource ID: c1f92285-12be-40d6-93ec-17820a93d121 with Priority: HIGHEST for action port [ 598.555596] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1f92285-12be-40d6-93ec-17820a93d121 with Priority: HIGHEST for action port [ 598.557471] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1f92285-12be-40d6-93ec-17820a93d121 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.557637] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1f92285-12be-40d6-93ec-17820a93d121" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.557703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1f92285-12be-40d6-93ec-17820a93d121" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.557980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1f92285-12be-40d6-93ec-17820a93d121" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.558230] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1f92285-12be-40d6-93ec-17820a93d121',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.569799] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.612645] env[62909]: INFO networking_nsxv3.common.synchronization [req-32f38336-f19f-4df1-9336-8758539d4be9 req-3d1f8105-1788-4002-b53c-739318f8f6fa tempest-FloatingIPsAssociationNegativeTestJSON-815623881 tempest-FloatingIPsAssociationNegativeTestJSON-815623881-project-member] Enqueued Resource ID: ba398af1-904a-41aa-b098-1f2b15a308ac with Priority: HIGHEST for action security_group_members [ 598.614171] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba398af1-904a-41aa-b098-1f2b15a308ac with Priority: HIGHEST for action security_group_members [ 598.614171] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba398af1-904a-41aa-b098-1f2b15a308ac taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.614171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.614171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.614171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.614171] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.614507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.614507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.614616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.614775] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.614775] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba398af1-904a-41aa-b098-1f2b15a308ac',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.697210] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3102ba9b-4eea-41ee-997c-a4ebb2ac9c97 [ 598.697210] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.697505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.697505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.697961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.698086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.698198] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3102ba9b-4eea-41ee-997c-a4ebb2ac9c97 already deleted. [ 598.698284] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3102ba9b-4eea-41ee-997c-a4ebb2ac9c97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.810768] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8ce285a-66b4-41d5-aa51-4bbc593d7d42 [ 598.811020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.811155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.811288] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.811518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.811605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.811702] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8ce285a-66b4-41d5-aa51-4bbc593d7d42 already deleted. [ 598.811994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8ce285a-66b4-41d5-aa51-4bbc593d7d42" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.010097] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2821bc4-3047-4598-bd51-10cd2a5b1137: rpc.has_security_group_logging(os_id): False [ 599.016226] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca in Status: SUCCESS [ 599.016226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.037824] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.040024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.040024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.040024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.040024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.040024] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.040024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.040024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.040024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.040024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.040024] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 is going to be created. [ 599.062720] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1f92285-12be-40d6-93ec-17820a93d121 [ 599.064620] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.064620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.064620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.064620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.064620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.064620] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1f92285-12be-40d6-93ec-17820a93d121 already deleted. [ 599.064620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1f92285-12be-40d6-93ec-17820a93d121" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.077188] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.079447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.079447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.079447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.079447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.079447] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 is going to be created. [ 599.118630] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.118630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.118630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.118630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.118630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.118920] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.118920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.118996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.119210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.119357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.119357] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba398af1-904a-41aa-b098-1f2b15a308ac already deleted. [ 599.119480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.130181] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.131059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.131059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.131059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.131059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.139536] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.139681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.139681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.139877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.140594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.146611] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: UNINITIALIZED for 2s [ 599.165407] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 in Status: IN_PROGRESS for 2s [ 599.444864] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.445226] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-765" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.445383] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-765" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.445803] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-765" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.446381] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.446500] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.446602] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.446893] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.447231] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.447320] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 599.447429] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.447537] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.447655] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.447762] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 599.447909] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.448029] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.478680] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.479851] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 599.480192] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.480530] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-765" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.481111] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-1e7a9bbc-61fa-4ecf-8142-2568ff07c25c taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.481454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-1e7a9bbc-61fa-4ecf-8142-2568ff07c25c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.482027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-1e7a9bbc-61fa-4ecf-8142-2568ff07c25c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.482027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-1e7a9bbc-61fa-4ecf-8142-2568ff07c25c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.483336] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e7a9bbc-61fa-4ecf-8142-2568ff07c25c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.490069] env[62909]: INFO networking_nsxv3.common.synchronization [None req-28e356c5-3c77-4139-81ab-47276f7cb3aa None None] Enqueued Resource ID: d3f72c6e-63b9-4efe-b5fa-2ee2ee492335 with Priority: HIGHEST for action port [ 599.490069] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f72c6e-63b9-4efe-b5fa-2ee2ee492335 with Priority: HIGHEST for action port [ 599.490069] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3f72c6e-63b9-4efe-b5fa-2ee2ee492335 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.490069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3f72c6e-63b9-4efe-b5fa-2ee2ee492335" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.490069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3f72c6e-63b9-4efe-b5fa-2ee2ee492335" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.490069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3f72c6e-63b9-4efe-b5fa-2ee2ee492335" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.490069] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3f72c6e-63b9-4efe-b5fa-2ee2ee492335',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.986414] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.989695] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.990017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.990489] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.990725] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.990979] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 1e7a9bbc-61fa-4ecf-8142-2568ff07c25c not found, creating... [ 599.991468] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.992362] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.992553] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.992918] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.993148] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.993670] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.993927] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.994122] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.994475] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.994687] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.994913] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 1e7a9bbc-61fa-4ecf-8142-2568ff07c25c is going to be created. [ 599.997343] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3f72c6e-63b9-4efe-b5fa-2ee2ee492335 [ 599.997605] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.997773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.997919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.998167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.998297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.998430] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3f72c6e-63b9-4efe-b5fa-2ee2ee492335 already deleted. [ 599.998548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3f72c6e-63b9-4efe-b5fa-2ee2ee492335" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.021463] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.021843] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.022043] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.022447] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.022797] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.023997] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-1e7a9bbc-61fa-4ecf-8142-2568ff07c25c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.067025] env[62909]: INFO networking_nsxv3.common.synchronization [None req-1a6bd96d-4cd1-4b5c-829e-63f154a066ea tempest-ServerActionsTestOtherB-1631848678 tempest-ServerActionsTestOtherB-1631848678-project-member] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 600.067025] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 600.067025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.067025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.067025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.067025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.067025] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.367536] env[62909]: INFO networking_nsxv3.common.synchronization [None req-22395099-4936-47e9-9f41-a8c3462c85f3 tempest-ServerActionsTestOtherB-1631848678 tempest-ServerActionsTestOtherB-1631848678-project-member] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 600.369133] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 600.369133] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.369133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.605570] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.606389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.606743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.607085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.610883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.610883] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a already deleted. [ 600.610883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.610883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.610883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.610883] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.137790] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.139151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.139151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.139151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.139151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.139426] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a already deleted. [ 601.139739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.158211] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: SUCCESS [ 601.159083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.159339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.159643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.163018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.163018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.163018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.163018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.163018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.163018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.163018] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.179466] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 in Status: SUCCESS [ 601.179687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.583076] env[62909]: INFO networking_nsxv3.common.synchronization [req-32f38336-f19f-4df1-9336-8758539d4be9 req-af0e53dd-ee1c-4b9a-94b9-c494c4e4bd63 service nova] Enqueued Resource ID: ba398af1-904a-41aa-b098-1f2b15a308ac with Priority: HIGHEST for action security_group_rules [ 601.583359] env[62909]: INFO networking_nsxv3.common.synchronization [req-32f38336-f19f-4df1-9336-8758539d4be9 req-af0e53dd-ee1c-4b9a-94b9-c494c4e4bd63 service nova] Enqueued Resource ID: ba398af1-904a-41aa-b098-1f2b15a308ac with Priority: HIGHEST for action security_group_members [ 601.583534] env[62909]: INFO networking_nsxv3.common.synchronization [req-32f38336-f19f-4df1-9336-8758539d4be9 req-af0e53dd-ee1c-4b9a-94b9-c494c4e4bd63 service nova] Enqueued Resource ID: 1e7a9bbc-61fa-4ecf-8142-2568ff07c25c with Priority: HIGHEST for action port [ 601.585281] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba398af1-904a-41aa-b098-1f2b15a308ac with Priority: HIGHEST for action security_group_rules [ 601.585427] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba398af1-904a-41aa-b098-1f2b15a308ac with Priority: HIGHEST for action security_group_members [ 601.585582] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e7a9bbc-61fa-4ecf-8142-2568ff07c25c with Priority: HIGHEST for action port [ 601.586160] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba398af1-904a-41aa-b098-1f2b15a308ac taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.586160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.586823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.586823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.587072] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba398af1-904a-41aa-b098-1f2b15a308ac',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.588112] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba398af1-904a-41aa-b098-1f2b15a308ac taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.588284] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.588471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.588696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.589310] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.589424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.589485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.589840] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.589924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.589973] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba398af1-904a-41aa-b098-1f2b15a308ac',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.591386] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e7a9bbc-61fa-4ecf-8142-2568ff07c25c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.591549] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e7a9bbc-61fa-4ecf-8142-2568ff07c25c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.591796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e7a9bbc-61fa-4ecf-8142-2568ff07c25c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.592323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e7a9bbc-61fa-4ecf-8142-2568ff07c25c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.592323] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e7a9bbc-61fa-4ecf-8142-2568ff07c25c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.666466] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.815517] env[62909]: INFO networking_nsxv3.common.synchronization [req-b2ee77b0-1da0-47e8-a9e1-93e52a47789d req-aa335901-c62b-471a-bfe0-d4397bf00451 tempest-ServersTestBootFromVolume-1983048922 tempest-ServersTestBootFromVolume-1983048922-project-member] Enqueued Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_members [ 601.815517] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_members [ 601.815517] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-9854b6b4-9fde-4807-83f9-b2838c42920a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.815517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.815517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.815517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.815517] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.815517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.815517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.815517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.815517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.815517] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9854b6b4-9fde-4807-83f9-b2838c42920a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.097056] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba398af1-904a-41aa-b098-1f2b15a308ac',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.097056] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba398af1-904a-41aa-b098-1f2b15a308ac taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.097056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.098492] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e7a9bbc-61fa-4ecf-8142-2568ff07c25c with status ACTIVE [ 602.098959] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.099160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.099316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.099573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.099671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.099905] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.100109] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.100193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.100374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.100460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.100694] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.100811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.100886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.101102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.101188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.101280] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e7a9bbc-61fa-4ecf-8142-2568ff07c25c is going to be updated. [ 602.133077] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.133077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.133077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.133077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.133077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.133077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e7a9bbc-61fa-4ecf-8142-2568ff07c25c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.167733] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a79ba361-9edb-4b9b-82c4-afa586cb4427: rpc.has_security_group_logging(os_id): False [ 602.183272] env[62909]: INFO networking_nsxv3.common.synchronization [None req-cf61a6a2-44f2-4a8b-8f61-66020f549a55 None None] Enqueued Resource ID: 855f6f64-5a53-4d29-895f-4e875e2f6787 with Priority: HIGHEST for action port [ 602.184328] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 855f6f64-5a53-4d29-895f-4e875e2f6787 with Priority: HIGHEST for action port [ 602.184677] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-855f6f64-5a53-4d29-895f-4e875e2f6787 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.184806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-855f6f64-5a53-4d29-895f-4e875e2f6787" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.184806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-855f6f64-5a53-4d29-895f-4e875e2f6787" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.186292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-855f6f64-5a53-4d29-895f-4e875e2f6787" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.186292] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('855f6f64-5a53-4d29-895f-4e875e2f6787',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.195226] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.195226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.195226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.195226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.195550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.197280] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.197280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.197280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.197280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.197280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.197280] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 is going to be created. [ 602.294512] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.294512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.294512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.294512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.294512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.313284] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: IN_PROGRESS for 2s [ 602.315741] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.316493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.316493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.318726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.318726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.318726] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.318726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.318726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.318726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.318726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.318726] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9854b6b4-9fde-4807-83f9-b2838c42920a already deleted. [ 602.318726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.598028] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba398af1-904a-41aa-b098-1f2b15a308ac',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.688927] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 855f6f64-5a53-4d29-895f-4e875e2f6787 [ 602.690297] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.691913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.692158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.692530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.696398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.696398] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:855f6f64-5a53-4d29-895f-4e875e2f6787 already deleted. [ 602.696398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-855f6f64-5a53-4d29-895f-4e875e2f6787" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.853630] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.855058] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-941" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.855815] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-941" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.858604] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-941" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.858604] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.858604] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.858604] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.858604] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.860837] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.861141] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 602.861270] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.861485] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.861485] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.861600] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 602.861704] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.861842] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.891141] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.891141] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 602.891303] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.891563] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-941" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.892176] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-fc7b353a-564b-4bbe-b0e1-85f5f54f7092 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.892345] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-fc7b353a-564b-4bbe-b0e1-85f5f54f7092" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.892556] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-fc7b353a-564b-4bbe-b0e1-85f5f54f7092" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.893904] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-fc7b353a-564b-4bbe-b0e1-85f5f54f7092" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.894193] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7b353a-564b-4bbe-b0e1-85f5f54f7092',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.101237] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.101418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.101493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.101711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.101798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.101909] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba398af1-904a-41aa-b098-1f2b15a308ac is going to be created. [ 603.132858] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.134089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.134215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.134463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.134647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.148429] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba398af1-904a-41aa-b098-1f2b15a308ac in Status: UNINITIALIZED for 2s [ 603.397409] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.397845] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.397913] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.398641] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.398641] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.398641] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port fc7b353a-564b-4bbe-b0e1-85f5f54f7092 not found, creating... [ 603.399124] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.399328] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.399376] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.399699] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.400164] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.400540] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.403177] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.403177] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.403177] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.403177] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.403177] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: fc7b353a-564b-4bbe-b0e1-85f5f54f7092 is going to be created. [ 603.425076] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.425719] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.426027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.427875] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.427875] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.427875] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-fc7b353a-564b-4bbe-b0e1-85f5f54f7092" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.472685] env[62909]: INFO networking_nsxv3.common.synchronization [req-9dd46ab1-2a15-4140-bb55-eebf4e50d4a5 req-de263588-5385-4612-8e9e-9f3149bee0ff tempest-DeleteServersAdminTestJSON-1168096843 tempest-DeleteServersAdminTestJSON-1168096843-project-admin] Enqueued Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 603.473348] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 603.473665] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.473802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.473892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.474068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.475443] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.475443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.475443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.475443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.475443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.475443] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.784725] env[62909]: INFO networking_nsxv3.common.synchronization [None req-6d251761-191a-4b0a-aac1-2e0df81f0e90 None None] Enqueued Resource ID: b1548cb1-478e-4c41-b8b0-0b777d0d170c with Priority: HIGHEST for action port [ 603.785845] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1548cb1-478e-4c41-b8b0-0b777d0d170c with Priority: HIGHEST for action port [ 603.785845] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1548cb1-478e-4c41-b8b0-0b777d0d170c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.786548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1548cb1-478e-4c41-b8b0-0b777d0d170c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.786654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1548cb1-478e-4c41-b8b0-0b777d0d170c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.787331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1548cb1-478e-4c41-b8b0-0b777d0d170c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.787555] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1548cb1-478e-4c41-b8b0-0b777d0d170c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.978987] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.978987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.978987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.978987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.978987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.978987] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.979703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.979703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.979703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.979703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.979703] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 is going to be updated. [ 604.069709] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.069709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.069978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.069978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.070117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.084077] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: IN_PROGRESS for 2s [ 604.290636] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1548cb1-478e-4c41-b8b0-0b777d0d170c [ 604.293711] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.293711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.293711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.293711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.293711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.293711] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1548cb1-478e-4c41-b8b0-0b777d0d170c already deleted. [ 604.293711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1548cb1-478e-4c41-b8b0-0b777d0d170c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.348061] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: SUCCESS [ 604.350160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.002937] env[62909]: INFO networking_nsxv3.common.synchronization [None req-7e65ca4b-2ac2-4972-a0f1-345309476572 None None] Enqueued Resource ID: 0a28e239-2acf-4ff5-830e-e2a9b0c75d47 with Priority: HIGHEST for action port [ 605.003579] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a28e239-2acf-4ff5-830e-e2a9b0c75d47 with Priority: HIGHEST for action port [ 605.004150] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a28e239-2acf-4ff5-830e-e2a9b0c75d47 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.004280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a28e239-2acf-4ff5-830e-e2a9b0c75d47" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.004349] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a28e239-2acf-4ff5-830e-e2a9b0c75d47" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.005453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a28e239-2acf-4ff5-830e-e2a9b0c75d47" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.005549] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a28e239-2acf-4ff5-830e-e2a9b0c75d47',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.162705] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba398af1-904a-41aa-b098-1f2b15a308ac in Status: SUCCESS [ 605.162705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.162705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.162705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.162705] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.163495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.163838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.164132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.164318] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.164498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.164848] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba398af1-904a-41aa-b098-1f2b15a308ac',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.214955] env[62909]: INFO networking_nsxv3.common.synchronization [req-58ac5507-06a3-4729-abb6-1d85e4a64a1f req-2b389e5e-ca9e-4960-a063-481716b644d1 tempest-ServerExternalEventsTest-1328511746 tempest-ServerExternalEventsTest-1328511746-project-member] Enqueued Resource ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 with Priority: HIGHEST for action security_group_members [ 605.214955] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 with Priority: HIGHEST for action security_group_members [ 605.214955] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7554444-3d48-4fef-b5ad-54687b70bfc1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.214955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.214955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.214955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.214955] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.214955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.214955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.214955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.214955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.214955] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7554444-3d48-4fef-b5ad-54687b70bfc1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.508084] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a28e239-2acf-4ff5-830e-e2a9b0c75d47 [ 605.508370] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.508506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.508573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.508795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.508882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.510244] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a28e239-2acf-4ff5-830e-e2a9b0c75d47 already deleted. [ 605.510244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a28e239-2acf-4ff5-830e-e2a9b0c75d47" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.660230] env[62909]: INFO networking_nsxv3.common.synchronization [req-b2ee77b0-1da0-47e8-a9e1-93e52a47789d req-42b65ab7-e2af-4c2e-b29f-1b9f26ee2431 service nova] Enqueued Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_rules [ 605.660230] env[62909]: INFO networking_nsxv3.common.synchronization [req-b2ee77b0-1da0-47e8-a9e1-93e52a47789d req-42b65ab7-e2af-4c2e-b29f-1b9f26ee2431 service nova] Enqueued Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_members [ 605.660230] env[62909]: INFO networking_nsxv3.common.synchronization [req-b2ee77b0-1da0-47e8-a9e1-93e52a47789d req-42b65ab7-e2af-4c2e-b29f-1b9f26ee2431 service nova] Enqueued Resource ID: fc7b353a-564b-4bbe-b0e1-85f5f54f7092 with Priority: HIGHEST for action port [ 605.660451] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_rules [ 605.662723] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_members [ 605.662723] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc7b353a-564b-4bbe-b0e1-85f5f54f7092 with Priority: HIGHEST for action port [ 605.662723] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9854b6b4-9fde-4807-83f9-b2838c42920a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.662723] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.662723] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.662723] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.662723] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9854b6b4-9fde-4807-83f9-b2838c42920a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.664286] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-9854b6b4-9fde-4807-83f9-b2838c42920a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.664286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.664286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.664286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.664286] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.664286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.664286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.664286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.664286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.665288] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9854b6b4-9fde-4807-83f9-b2838c42920a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.668567] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc7b353a-564b-4bbe-b0e1-85f5f54f7092 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.668567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc7b353a-564b-4bbe-b0e1-85f5f54f7092" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.668567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc7b353a-564b-4bbe-b0e1-85f5f54f7092" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.668567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc7b353a-564b-4bbe-b0e1-85f5f54f7092" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.668567] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7b353a-564b-4bbe-b0e1-85f5f54f7092',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.670084] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba398af1-904a-41aa-b098-1f2b15a308ac taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.670084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.670084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.670084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.670084] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.670084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.670084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.670392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.670392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.670392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.671915] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba398af1-904a-41aa-b098-1f2b15a308ac taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.671915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.671915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.672236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.672236] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.672320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.672884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.672884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.673491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.673491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.673606] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba398af1-904a-41aa-b098-1f2b15a308ac',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.720021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.720021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.720021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.720021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.720021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.720021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.720021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.720021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.720423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.720423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.720423] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 already deleted. [ 605.720423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.097351] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: SUCCESS [ 606.097351] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 deletion is rescheduled due to dependency. [ 606.097351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.170257] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9854b6b4-9fde-4807-83f9-b2838c42920a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.170257] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-9854b6b4-9fde-4807-83f9-b2838c42920a taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.170257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.175692] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc7b353a-564b-4bbe-b0e1-85f5f54f7092 with status ACTIVE [ 606.175915] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.176070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.176142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.176633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.176786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.176995] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.177111] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.177179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.177335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.177420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.183027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.183027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.183027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.183027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.183027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.183027] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc7b353a-564b-4bbe-b0e1-85f5f54f7092 is going to be updated. [ 606.183027] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba398af1-904a-41aa-b098-1f2b15a308ac: rpc.has_security_group_logging(os_id): False [ 606.207463] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.208033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.208033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.208033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.208033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.210182] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.210182] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.210182] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.210182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.212996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.212996] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba398af1-904a-41aa-b098-1f2b15a308ac is going to be created. [ 606.225469] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.225871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.225990] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.226288] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.226428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.226585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc7b353a-564b-4bbe-b0e1-85f5f54f7092" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.314780] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.315290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.315290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.315459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.316766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.330064] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba398af1-904a-41aa-b098-1f2b15a308ac in Status: IN_PROGRESS for 2s [ 606.491987] env[62909]: INFO networking_nsxv3.common.synchronization [req-edcbf416-5890-4882-b827-401b91a888a6 req-4fe079a8-da97-40f0-b809-845e145bf32a tempest-ServerDiagnosticsNegativeTest-45432392 tempest-ServerDiagnosticsNegativeTest-45432392-project-member] Enqueued Resource ID: cdf04703-55f3-479f-bb4c-a69bd221f98f with Priority: HIGHEST for action security_group_members [ 606.492653] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf04703-55f3-479f-bb4c-a69bd221f98f with Priority: HIGHEST for action security_group_members [ 606.493009] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf04703-55f3-479f-bb4c-a69bd221f98f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.497022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.497022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.497022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.497022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.497022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.497022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.497022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.497022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.497022] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf04703-55f3-479f-bb4c-a69bd221f98f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.670809] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9854b6b4-9fde-4807-83f9-b2838c42920a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.882479] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.882706] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.882845] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.883163] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.883509] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.883626] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.883737] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.883950] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.884120] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.884372] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 606.884486] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 606.884588] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 606.884897] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 606.885074] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 606.885203] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 606.885356] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 606.911514] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 606.912779] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 606.912779] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 606.912779] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.913419] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.913419] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.913419] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.915065] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.915065] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.001020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.002017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.002017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.002017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.002017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.002017] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.002232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.002232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.005463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.005463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.005463] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf04703-55f3-479f-bb4c-a69bd221f98f is going to be updated. [ 607.039228] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.039228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.039526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.039526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.039656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.049218] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf04703-55f3-479f-bb4c-a69bd221f98f in Status: IN_PROGRESS for 2s [ 607.173527] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.174041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.174041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.174240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.174240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.174326] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9854b6b4-9fde-4807-83f9-b2838c42920a is going to be created. [ 607.207917] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.207917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.207917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.208401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.208401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.220981] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9854b6b4-9fde-4807-83f9-b2838c42920a in Status: UNINITIALIZED for 2s [ 607.417801] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.417801] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.417801] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.417991] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.418398] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.418398] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b not found, creating... [ 607.421214] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.421214] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.421214] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.421214] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.421214] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.421214] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.421214] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.421592] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.421805] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.422060] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.422190] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b is going to be created. [ 607.449049] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.449456] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.449631] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.449971] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.450649] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.450649] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.345238] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba398af1-904a-41aa-b098-1f2b15a308ac in Status: SUCCESS [ 608.345238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.488187] env[62909]: INFO networking_nsxv3.common.synchronization [None req-78909a02-bc00-411e-a4d8-25bab59f78de None None] Enqueued Resource ID: 35a663ca-26b9-4059-b234-d82691b162ff with Priority: HIGHEST for action port [ 608.491398] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35a663ca-26b9-4059-b234-d82691b162ff with Priority: HIGHEST for action port [ 608.491398] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-35a663ca-26b9-4059-b234-d82691b162ff taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.491867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35a663ca-26b9-4059-b234-d82691b162ff" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.491867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35a663ca-26b9-4059-b234-d82691b162ff" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.492101] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35a663ca-26b9-4059-b234-d82691b162ff" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.492232] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35a663ca-26b9-4059-b234-d82691b162ff',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.678313] env[62909]: INFO networking_nsxv3.common.synchronization [req-58ac5507-06a3-4729-abb6-1d85e4a64a1f req-7e92b0ec-7cac-4227-800c-4b0476ad97a7 service nova] Enqueued Resource ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 with Priority: HIGHEST for action security_group_rules [ 608.678603] env[62909]: INFO networking_nsxv3.common.synchronization [req-58ac5507-06a3-4729-abb6-1d85e4a64a1f req-7e92b0ec-7cac-4227-800c-4b0476ad97a7 service nova] Enqueued Resource ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 with Priority: HIGHEST for action security_group_members [ 608.678719] env[62909]: INFO networking_nsxv3.common.synchronization [req-58ac5507-06a3-4729-abb6-1d85e4a64a1f req-7e92b0ec-7cac-4227-800c-4b0476ad97a7 service nova] Enqueued Resource ID: b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b with Priority: HIGHEST for action port [ 608.679217] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 with Priority: HIGHEST for action security_group_rules [ 608.679358] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 with Priority: HIGHEST for action security_group_members [ 608.679445] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b with Priority: HIGHEST for action port [ 608.679697] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7554444-3d48-4fef-b5ad-54687b70bfc1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.679822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.679884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.680606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.680781] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7554444-3d48-4fef-b5ad-54687b70bfc1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.681607] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7554444-3d48-4fef-b5ad-54687b70bfc1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.681726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.681793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.682030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.683281] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.683454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.683540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.683776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.683897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.683931] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7554444-3d48-4fef-b5ad-54687b70bfc1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.687270] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.687409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.687472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.687684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.687780] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.874736] env[62909]: INFO networking_nsxv3.common.synchronization [req-d32333a2-7689-4520-9356-4a10fac92638 req-2f172a01-bf1d-4bc5-83ce-5790c5d8163c tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_members [ 608.877116] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_members [ 608.877116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-b723f584-c976-4351-bfcd-6ca761e670dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.877116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.877116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.877116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.877116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.877116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.877414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.877414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.877478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.877605] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.997363] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35a663ca-26b9-4059-b234-d82691b162ff [ 608.998099] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.998099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.998099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.998099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.998401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.998401] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35a663ca-26b9-4059-b234-d82691b162ff already deleted. [ 608.998501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35a663ca-26b9-4059-b234-d82691b162ff" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.065544] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf04703-55f3-479f-bb4c-a69bd221f98f in Status: SUCCESS [ 609.065544] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf04703-55f3-479f-bb4c-a69bd221f98f deletion is rescheduled due to dependency. [ 609.065544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.190367] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7554444-3d48-4fef-b5ad-54687b70bfc1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.191887] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7554444-3d48-4fef-b5ad-54687b70bfc1 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.192121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.192185] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b with status ACTIVE [ 609.192876] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.192876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.192876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.193282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.193282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.193378] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.193578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.193578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.193859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.193859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.194698] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.194698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.194698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.194698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.195251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.195251] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b is going to be updated. [ 609.225112] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.225112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.225112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.225429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.225429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.225772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0ce4bc2-c00c-4a33-98a7-b813f5b73a2b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.235041] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9854b6b4-9fde-4807-83f9-b2838c42920a in Status: SUCCESS [ 609.235624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.235624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.235817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.236327] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.236489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.236919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.236919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.237078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.237078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.237191] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9854b6b4-9fde-4807-83f9-b2838c42920a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.379959] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.380285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.380285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.380446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.380516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.380732] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.380834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.380898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.381059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.381140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.381227] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b723f584-c976-4351-bfcd-6ca761e670dd already deleted. [ 609.381307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.587734] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.587939] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.588073] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.588502] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.588795] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.588964] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.589092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.589393] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.589538] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.589743] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 609.589874] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.589988] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.590150] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.590288] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 609.590431] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.590636] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.620341] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.620341] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 609.620558] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.620612] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.624138] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-b92603ac-8bea-4f9a-aa50-8c942106916d taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.624138] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-b92603ac-8bea-4f9a-aa50-8c942106916d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.624138] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-b92603ac-8bea-4f9a-aa50-8c942106916d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.624138] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-b92603ac-8bea-4f9a-aa50-8c942106916d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.624138] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b92603ac-8bea-4f9a-aa50-8c942106916d',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.698742] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7554444-3d48-4fef-b5ad-54687b70bfc1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.740629] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9854b6b4-9fde-4807-83f9-b2838c42920a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.124268] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.124505] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.124648] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.124950] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.125104] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.125556] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port b92603ac-8bea-4f9a-aa50-8c942106916d not found, creating... [ 610.125843] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.126014] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.126129] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.126394] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.126530] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.126832] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.126987] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.127121] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.128065] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.128065] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.128065] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: b92603ac-8bea-4f9a-aa50-8c942106916d is going to be created. [ 610.152143] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.152474] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.152693] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.153496] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.153964] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.155670] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-b92603ac-8bea-4f9a-aa50-8c942106916d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.201476] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.203351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.203524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.203721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.203847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.203910] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 is going to be created. [ 610.237504] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.237728] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.237728] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.238070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.238344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.247331] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9854b6b4-9fde-4807-83f9-b2838c42920a: rpc.has_security_group_logging(os_id): False [ 610.251493] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 in Status: UNINITIALIZED for 2s [ 610.271575] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.271833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.271948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.272202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.272370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.272559] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.275184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.276240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.276689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.276689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.276689] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9854b6b4-9fde-4807-83f9-b2838c42920a is going to be created. [ 610.380458] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.380458] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.380458] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.381101] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.381101] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.395482] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9854b6b4-9fde-4807-83f9-b2838c42920a in Status: IN_PROGRESS for 2s [ 611.945603] env[62909]: INFO networking_nsxv3.common.synchronization [req-ca8fd23b-0874-4abc-a0f8-dc586b2b144a req-01dda3b0-1ef7-455d-af89-e4d813497bdb tempest-ImagesTestJSON-652168268 tempest-ImagesTestJSON-652168268-project-member] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 611.946132] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 611.946548] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.946747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.946804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.947382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.947656] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.947821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.947821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.948118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.948168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.948310] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.174385] env[62909]: INFO networking_nsxv3.common.synchronization [req-d32333a2-7689-4520-9356-4a10fac92638 req-643ffe74-d517-4776-bb84-4415fe76fa3e service nova] Enqueued Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_rules [ 612.174703] env[62909]: INFO networking_nsxv3.common.synchronization [req-d32333a2-7689-4520-9356-4a10fac92638 req-643ffe74-d517-4776-bb84-4415fe76fa3e service nova] Enqueued Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_members [ 612.174951] env[62909]: INFO networking_nsxv3.common.synchronization [req-d32333a2-7689-4520-9356-4a10fac92638 req-643ffe74-d517-4776-bb84-4415fe76fa3e service nova] Enqueued Resource ID: b92603ac-8bea-4f9a-aa50-8c942106916d with Priority: HIGHEST for action port [ 612.181219] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_rules [ 612.181219] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_members [ 612.181219] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b92603ac-8bea-4f9a-aa50-8c942106916d with Priority: HIGHEST for action port [ 612.181219] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b723f584-c976-4351-bfcd-6ca761e670dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.181219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.181219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.181219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.181219] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.181219] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-b723f584-c976-4351-bfcd-6ca761e670dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.181219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.181219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.181219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.181219] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.181219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.181219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.182455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.182722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.182995] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.185109] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b92603ac-8bea-4f9a-aa50-8c942106916d taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.187129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b92603ac-8bea-4f9a-aa50-8c942106916d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.187129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b92603ac-8bea-4f9a-aa50-8c942106916d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.187129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b92603ac-8bea-4f9a-aa50-8c942106916d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.187129] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b92603ac-8bea-4f9a-aa50-8c942106916d',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.264548] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 in Status: SUCCESS [ 612.265582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.265582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.265582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.266638] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.266638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.266638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.266842] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.266842] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.266981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.267034] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7554444-3d48-4fef-b5ad-54687b70bfc1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.414189] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9854b6b4-9fde-4807-83f9-b2838c42920a in Status: SUCCESS [ 612.414849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.452212] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.452212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.452212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.452425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.452425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.452579] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.453474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.453474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.453474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.453474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.453474] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa already deleted. [ 612.453474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.692518] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.694110] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-b723f584-c976-4351-bfcd-6ca761e670dd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.694110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.694110] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b92603ac-8bea-4f9a-aa50-8c942106916d with status ACTIVE [ 612.694110] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.694110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.694110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.694110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.694505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.694505] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.694505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.694749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.694749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.694749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.694922] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.696643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.696695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.698016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.698016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.698016] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b92603ac-8bea-4f9a-aa50-8c942106916d is going to be updated. [ 612.720272] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.720414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.720478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.720709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.721495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.721495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b92603ac-8bea-4f9a-aa50-8c942106916d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.734483] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.735603] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.735603] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.735603] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.735603] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.735838] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.735975] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.736511] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.736511] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.736853] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 612.736963] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.737971] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.737971] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.737971] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 612.737971] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.737971] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.763476] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.763476] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 612.763476] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.763476] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.763476] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-5dee04a2-563a-4fb4-8651-bec18ae531ea taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.763476] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-5dee04a2-563a-4fb4-8651-bec18ae531ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.763476] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-5dee04a2-563a-4fb4-8651-bec18ae531ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.763476] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-5dee04a2-563a-4fb4-8651-bec18ae531ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.763878] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dee04a2-563a-4fb4-8651-bec18ae531ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.770109] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7554444-3d48-4fef-b5ad-54687b70bfc1 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.770265] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.770512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.770512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.770839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.770839] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.771069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.771301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.771301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.771383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.771775] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7554444-3d48-4fef-b5ad-54687b70bfc1 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.771775] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.771775] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.771918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.772472] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.772472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.772472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.772472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.772472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.772695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.772695] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7554444-3d48-4fef-b5ad-54687b70bfc1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.936882] env[62909]: INFO networking_nsxv3.common.synchronization [req-1e9492e3-c61f-4e52-a70f-f3e61cff29ed req-a6f7dd9a-55c4-4df1-85d7-10fe2340b541 tempest-ServerDiagnosticsTest-352645101 tempest-ServerDiagnosticsTest-352645101-project-member] Enqueued Resource ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 with Priority: HIGHEST for action security_group_members [ 612.936882] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 with Priority: HIGHEST for action security_group_members [ 612.937167] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f700c8-ea6e-4561-84ab-c40836ff4286 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.937305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.937713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.937713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.937713] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.938201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.938201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.939507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.939507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.939507] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f700c8-ea6e-4561-84ab-c40836ff4286',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.199395] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.267928] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.267928] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.268210] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.268949] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.272601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.272601] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 5dee04a2-563a-4fb4-8651-bec18ae531ea not found, creating... [ 613.272601] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.272601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.272601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.272601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.272601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.272601] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.272601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.272601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.273130] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.273130] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.273130] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 5dee04a2-563a-4fb4-8651-bec18ae531ea is going to be created. [ 613.274929] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7554444-3d48-4fef-b5ad-54687b70bfc1: rpc.has_security_group_logging(os_id): False [ 613.310459] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.310642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.310734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.311494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.311494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.311494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.311494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.311494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.311880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.311880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.314664] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.317444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.317444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.317444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.317444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.317444] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.317444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.317444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.317444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.317444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.317444] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 is going to be created. [ 613.320759] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.320759] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.320759] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.320759] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.320759] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.320759] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-5dee04a2-563a-4fb4-8651-bec18ae531ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.431062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.431062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.431062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.431062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.431062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.443051] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.443305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.443305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.443533] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.444058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.444058] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.444058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.444058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.445239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.445239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.445239] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 is going to be updated. [ 613.446843] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 in Status: IN_PROGRESS for 2s [ 613.491026] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.491026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.491026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.491026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.491026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.505306] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 in Status: IN_PROGRESS for 2s [ 613.701588] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.701588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.701588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.702495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.702495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.702495] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b723f584-c976-4351-bfcd-6ca761e670dd is going to be created. [ 613.729256] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.729526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.729673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.730245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.730837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.743574] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b723f584-c976-4351-bfcd-6ca761e670dd in Status: UNINITIALIZED for 2s [ 614.560985] env[62909]: INFO networking_nsxv3.common.synchronization [req-ca8fd23b-0874-4abc-a0f8-dc586b2b144a req-35a6bf12-4adf-4007-b939-0c364e79fc68 service nova] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_rules [ 614.561584] env[62909]: INFO networking_nsxv3.common.synchronization [req-ca8fd23b-0874-4abc-a0f8-dc586b2b144a req-35a6bf12-4adf-4007-b939-0c364e79fc68 service nova] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 614.561584] env[62909]: INFO networking_nsxv3.common.synchronization [req-ca8fd23b-0874-4abc-a0f8-dc586b2b144a req-35a6bf12-4adf-4007-b939-0c364e79fc68 service nova] Enqueued Resource ID: 5dee04a2-563a-4fb4-8651-bec18ae531ea with Priority: HIGHEST for action port [ 614.561584] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_rules [ 614.561753] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 614.561753] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dee04a2-563a-4fb4-8651-bec18ae531ea with Priority: HIGHEST for action port [ 614.563096] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.563096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 614.563096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.563096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.564323] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.565516] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.565638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 614.565638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.565837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.566469] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.566469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 614.566469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.566469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.566469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 614.566733] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.568765] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dee04a2-563a-4fb4-8651-bec18ae531ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.568884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dee04a2-563a-4fb4-8651-bec18ae531ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 614.568961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dee04a2-563a-4fb4-8651-bec18ae531ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.569230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dee04a2-563a-4fb4-8651-bec18ae531ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.569412] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dee04a2-563a-4fb4-8651-bec18ae531ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.071212] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.072169] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.073237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.073705] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dee04a2-563a-4fb4-8651-bec18ae531ea with status ACTIVE [ 615.073903] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.074087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.074190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.074427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.074744] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.074814] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.074911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.075011] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.075299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.075333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.075531] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.075765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.075861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.076187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.076339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.077038] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dee04a2-563a-4fb4-8651-bec18ae531ea is going to be updated. [ 615.109038] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.109038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.109038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.109038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.109038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.109038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dee04a2-563a-4fb4-8651-bec18ae531ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.462703] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 in Status: SUCCESS [ 615.462967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.528512] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 in Status: SUCCESS [ 615.528512] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 deletion is rescheduled due to dependency. [ 615.528512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.574278] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.763187] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b723f584-c976-4351-bfcd-6ca761e670dd in Status: SUCCESS [ 615.763187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.763187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.763187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.763362] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.763421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.763459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.764895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.764895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.764895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.764895] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.077144] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.077386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.077386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.078090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.078090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.078090] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be created. [ 616.107848] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.107848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.107848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.107848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.107848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.119837] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: UNINITIALIZED for 2s [ 616.270430] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.399271] env[62909]: INFO networking_nsxv3.common.synchronization [None req-37c4b524-7742-4b51-b4f1-84679e57f9e9 None None] Enqueued Resource ID: e3a9adce-e12a-47da-a7c1-c26161e5edc7 with Priority: HIGHEST for action port [ 616.399971] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3a9adce-e12a-47da-a7c1-c26161e5edc7 with Priority: HIGHEST for action port [ 616.400363] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3a9adce-e12a-47da-a7c1-c26161e5edc7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.400512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3a9adce-e12a-47da-a7c1-c26161e5edc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.400593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3a9adce-e12a-47da-a7c1-c26161e5edc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.401958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3a9adce-e12a-47da-a7c1-c26161e5edc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.402131] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3a9adce-e12a-47da-a7c1-c26161e5edc7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.778218] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b723f584-c976-4351-bfcd-6ca761e670dd: rpc.has_security_group_logging(os_id): False [ 616.798506] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.798506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.798506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.798946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.798946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.799156] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.799282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.799282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.800369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.800369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.800369] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b723f584-c976-4351-bfcd-6ca761e670dd is going to be created. [ 616.872519] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.874886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.874886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.874886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.874886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.888682] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b723f584-c976-4351-bfcd-6ca761e670dd in Status: IN_PROGRESS for 2s [ 616.903984] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3a9adce-e12a-47da-a7c1-c26161e5edc7 [ 616.904378] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.904535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.904622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.904925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.905046] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.905136] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3a9adce-e12a-47da-a7c1-c26161e5edc7 already deleted. [ 616.905259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3a9adce-e12a-47da-a7c1-c26161e5edc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.504674] env[62909]: INFO networking_nsxv3.common.synchronization [req-3227f128-576f-46c8-9aa2-c7b16e27e4e6 req-6753aaf6-c4c7-4019-834e-abb3fc570fd2 tempest-InstanceActionsTestJSON-94509073 tempest-InstanceActionsTestJSON-94509073-project-member] Enqueued Resource ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 with Priority: HIGHEST for action security_group_members [ 617.505351] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 with Priority: HIGHEST for action security_group_members [ 617.505758] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2b03ac3-37c4-4e87-91a0-aaa294062815 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.505888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.506029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.506401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.512648] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.512648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.512871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.512934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.514442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.514925] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2b03ac3-37c4-4e87-91a0-aaa294062815',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.018983] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.019301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.019376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.019605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.019732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.019998] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.020150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.020237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.020447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.020580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.020727] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 is going to be updated. [ 618.056062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.056328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.056328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.057206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.057206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.073684] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 in Status: IN_PROGRESS for 2s [ 618.130064] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 618.130280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.130448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.130669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.130852] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.130972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.131051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.131212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.131770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.131770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.131770] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.607213] env[62909]: INFO networking_nsxv3.common.synchronization [req-60e2f5c0-21ad-4eb9-9ec5-1228db55bb8d req-f7b1f922-eb5a-4a85-9971-0591be43db95 tempest-ServersAdminNegativeTestJSON-1035945787 tempest-ServersAdminNegativeTestJSON-1035945787-project-member] Enqueued Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 618.607213] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 618.607213] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.608183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.608183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.608183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.608396] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.608521] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.608582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.608756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.608838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.608937] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.635884] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.635884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.635884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.635884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.635884] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.635884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.636169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.636169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.636229] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.637018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.637018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.637018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.637018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.637018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.637018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.637018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.637360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.637499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.637574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.637678] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.637925] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.904518] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b723f584-c976-4351-bfcd-6ca761e670dd in Status: SUCCESS [ 618.904518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.012363] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.012750] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.012972] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.013329] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.013682] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.013971] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.014259] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.014581] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.014832] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.015141] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 619.015341] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.015542] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.015801] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.017921] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 619.017921] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.017921] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.039065] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.039065] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 619.039065] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.039065] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.039065] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-99005c2d-b79b-4aba-b30d-613274dad233 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.039065] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-99005c2d-b79b-4aba-b30d-613274dad233" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.039065] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-99005c2d-b79b-4aba-b30d-613274dad233" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.039065] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-99005c2d-b79b-4aba-b30d-613274dad233" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.039065] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99005c2d-b79b-4aba-b30d-613274dad233',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.115606] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.141787] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 828a3fee-5001-4141-bcfb-64c185ab0efa: rpc.has_security_group_logging(os_id): False [ 619.163321] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.163518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.163613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.163906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.164105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.164411] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.164489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.164561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.164781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.164893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.165298] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.165587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.165781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.166155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.166385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.166682] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.166823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.167060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.167156] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.167296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.167466] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be created. [ 619.242245] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.242245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.242245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.242245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.242245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.262242] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 619.542951] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.543192] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.543363] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.543738] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.543965] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.545040] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 99005c2d-b79b-4aba-b30d-613274dad233 not found, creating... [ 619.545040] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.545040] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.545040] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.545869] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.546170] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.546622] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.547067] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.547287] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.547616] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.547846] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.548090] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 99005c2d-b79b-4aba-b30d-613274dad233 is going to be created. [ 619.570969] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.571225] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.571308] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.571591] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.571932] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.572058] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-99005c2d-b79b-4aba-b30d-613274dad233" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.621925] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.993471] env[62909]: INFO networking_nsxv3.common.synchronization [None req-0605995b-2b74-4a75-95a0-8536e5091a3d None None] Enqueued Resource ID: d386a337-19d6-4a0f-b982-94b274b16825 with Priority: HIGHEST for action port [ 619.993979] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d386a337-19d6-4a0f-b982-94b274b16825 with Priority: HIGHEST for action port [ 619.994327] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-d386a337-19d6-4a0f-b982-94b274b16825 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.994442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d386a337-19d6-4a0f-b982-94b274b16825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.994526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d386a337-19d6-4a0f-b982-94b274b16825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.994948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d386a337-19d6-4a0f-b982-94b274b16825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.995650] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d386a337-19d6-4a0f-b982-94b274b16825',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.083922] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 in Status: SUCCESS [ 620.084295] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 deletion is rescheduled due to dependency. [ 620.084295] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.127560] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.127560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.127560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.127560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.127560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.127560] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d635d2b-1797-4206-b032-b7450c1074bc is going to be updated. [ 620.158198] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.158198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.158198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.158198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.158198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.166358] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: IN_PROGRESS for 2s [ 620.186604] env[62909]: INFO networking_nsxv3.common.synchronization [req-fc0be165-60b7-49d8-aeb6-119024cbfaeb req-f623e98e-b16b-4b5a-b960-43f86738d8f5 tempest-VolumesAdminNegativeTest-328242297 tempest-VolumesAdminNegativeTest-328242297-project-member] Enqueued Resource ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca with Priority: HIGHEST for action security_group_members [ 620.191025] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca with Priority: HIGHEST for action security_group_members [ 620.191025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-14d66eff-4d06-4f86-92c4-66d09f1004ca taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.191025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.191025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.191025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.191025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.191025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.191025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.191025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.191025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.191025] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14d66eff-4d06-4f86-92c4-66d09f1004ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.332283] env[62909]: INFO networking_nsxv3.common.synchronization [None req-87fcaada-4d4e-4df3-a697-89910ce3edb3 None None] Enqueued Resource ID: 7db8f58d-3cd3-4d4b-ae99-07c69e63d641 with Priority: HIGHEST for action port [ 620.332283] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db8f58d-3cd3-4d4b-ae99-07c69e63d641 with Priority: HIGHEST for action port [ 620.332283] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-7db8f58d-3cd3-4d4b-ae99-07c69e63d641 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.332283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7db8f58d-3cd3-4d4b-ae99-07c69e63d641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.332283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7db8f58d-3cd3-4d4b-ae99-07c69e63d641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.332498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7db8f58d-3cd3-4d4b-ae99-07c69e63d641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.332498] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7db8f58d-3cd3-4d4b-ae99-07c69e63d641',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.499422] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d386a337-19d6-4a0f-b982-94b274b16825 [ 620.499759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.499923] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.499996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.500257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.500433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.500508] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d386a337-19d6-4a0f-b982-94b274b16825 already deleted. [ 620.500548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d386a337-19d6-4a0f-b982-94b274b16825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.577804] env[62909]: INFO networking_nsxv3.common.synchronization [req-60e2f5c0-21ad-4eb9-9ec5-1228db55bb8d req-5a032f0d-6829-4197-8959-c1c5a0e9e281 service nova] Enqueued Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_rules [ 620.577804] env[62909]: INFO networking_nsxv3.common.synchronization [req-60e2f5c0-21ad-4eb9-9ec5-1228db55bb8d req-5a032f0d-6829-4197-8959-c1c5a0e9e281 service nova] Enqueued Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 620.577804] env[62909]: INFO networking_nsxv3.common.synchronization [req-60e2f5c0-21ad-4eb9-9ec5-1228db55bb8d req-5a032f0d-6829-4197-8959-c1c5a0e9e281 service nova] Enqueued Resource ID: 99005c2d-b79b-4aba-b30d-613274dad233 with Priority: HIGHEST for action port [ 620.577804] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_rules [ 620.577804] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 620.577804] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99005c2d-b79b-4aba-b30d-613274dad233 with Priority: HIGHEST for action port [ 620.577804] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.580058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.580357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.581140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.581317] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.583831] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.584711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.587959] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-99005c2d-b79b-4aba-b30d-613274dad233 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.587959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99005c2d-b79b-4aba-b30d-613274dad233" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.587959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99005c2d-b79b-4aba-b30d-613274dad233" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.587959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99005c2d-b79b-4aba-b30d-613274dad233" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.587959] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99005c2d-b79b-4aba-b30d-613274dad233',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.695046] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.695046] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.695046] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.695309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.695309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.695880] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.695880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.695880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.695880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.695880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.695880] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca is going to be updated. [ 620.746943] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.747183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.747183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.747483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.747602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.762694] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca in Status: IN_PROGRESS for 2s [ 620.834376] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7db8f58d-3cd3-4d4b-ae99-07c69e63d641 [ 620.834635] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.834770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.834839] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.835077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.838325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.838325] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7db8f58d-3cd3-4d4b-ae99-07c69e63d641 already deleted. [ 620.838325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7db8f58d-3cd3-4d4b-ae99-07c69e63d641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.090428] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.090812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.090812] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99005c2d-b79b-4aba-b30d-613274dad233 with status ACTIVE [ 621.091490] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.091490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.091490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.091490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.091490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.091801] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.091801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.091904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.091990] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.092123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.092346] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.092491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.092589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.092954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.092954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.093095] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99005c2d-b79b-4aba-b30d-613274dad233 is going to be updated. [ 621.118275] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.118457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.118528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.118750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.118892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.119066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99005c2d-b79b-4aba-b30d-613274dad233" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.184963] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-d7ac2f7b-cb5a-444a-8fed-ebdc7777203f tempest-ServersTestMultiNic-523841259 tempest-ServersTestMultiNic-523841259-project-member] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 621.186124] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 621.186600] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.186680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.186744] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.188105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.188595] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.188595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.189202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.189202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.189202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.189202] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.277549] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 621.277776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.692055] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.692055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.692055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.692310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.692464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.692919] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.693062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.693605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.693605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.693719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.693799] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 already deleted. [ 621.693896] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.847374] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-ee5f245e-292b-405d-a726-826f4d7789e3 tempest-ServersTestMultiNic-523841259 tempest-ServersTestMultiNic-523841259-project-member] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 621.847968] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 621.848574] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.850282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.850282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.850282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.850282] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.850282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.850282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.850282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.850282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.850282] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.073976] env[62909]: INFO networking_nsxv3.common.synchronization [None req-a04be748-03f5-477c-bba3-8aadffa4eea1 tempest-ServersTestFqdnHostnames-2028362432 tempest-ServersTestFqdnHostnames-2028362432-project-member] Enqueued Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_rules [ 622.074506] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_rules [ 622.074862] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91426ce9-c57f-42ef-bcee-74c76f9876e0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.075011] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.075115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.075626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.075626] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91426ce9-c57f-42ef-bcee-74c76f9876e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.170326] env[62909]: INFO networking_nsxv3.common.synchronization [None req-5a8d748e-8d58-4f32-9963-1db0c2e6ed73 tempest-ServersTestFqdnHostnames-2028362432 tempest-ServersTestFqdnHostnames-2028362432-project-member] Enqueued Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_rules [ 622.171255] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_rules [ 622.171571] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91426ce9-c57f-42ef-bcee-74c76f9876e0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.171671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.183433] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: SUCCESS [ 622.183661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.184226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.184457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.184633] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.184747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.184810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.184963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.185050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.188956] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.352888] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.353339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.353441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.353685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.353828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.354614] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.354614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.354614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.354614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.354614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.354614] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 already deleted. [ 622.354614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.415492] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-37819ef6-21e6-4b41-b912-0bd7105e76df tempest-ServersTestMultiNic-523841259 tempest-ServersTestMultiNic-523841259-project-member] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 622.416071] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 622.416756] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.416897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.416978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.417434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.417944] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.417944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.418054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.418138] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.418225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.418449] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.607292] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.607292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.607292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.607292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.607292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.607292] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 already deleted. [ 622.607292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.607292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.607292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.607292] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91426ce9-c57f-42ef-bcee-74c76f9876e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.693059] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.771276] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca in Status: SUCCESS [ 622.771458] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca deletion is rescheduled due to dependency. [ 622.771577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.924796] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.924796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.924796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.924796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.924796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.924796] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.924796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.924796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.924796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.924796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.924796] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 already deleted. [ 622.924796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.129053] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-235 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.129292] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-235" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.129458] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-235" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.129775] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-235" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.134981] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.134981] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.134981] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.134981] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.134981] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.134981] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.134981] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.134981] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.134981] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.134981] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.135475] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.135475] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.140818] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.140818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.140818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.140818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.140818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.140818] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 already deleted. [ 623.141132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.158946] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.159264] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 623.159264] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.159551] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-235" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.159727] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-668a09a1-427d-4507-b7d0-45cab066cac8 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.159903] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-668a09a1-427d-4507-b7d0-45cab066cac8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.160029] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-668a09a1-427d-4507-b7d0-45cab066cac8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.160355] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-668a09a1-427d-4507-b7d0-45cab066cac8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.160492] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('668a09a1-427d-4507-b7d0-45cab066cac8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.195079] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.422414] env[62909]: INFO networking_nsxv3.common.synchronization [None req-d914f17c-6fa1-4f51-8e9a-eb4cfefb2bdf None None] Enqueued Resource ID: 2b11a855-bfed-439a-98dd-be76c02ee008 with Priority: HIGHEST for action port [ 623.422981] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b11a855-bfed-439a-98dd-be76c02ee008 with Priority: HIGHEST for action port [ 623.423670] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b11a855-bfed-439a-98dd-be76c02ee008 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.423670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b11a855-bfed-439a-98dd-be76c02ee008" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.423670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b11a855-bfed-439a-98dd-be76c02ee008" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.424204] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b11a855-bfed-439a-98dd-be76c02ee008" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.424352] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b11a855-bfed-439a-98dd-be76c02ee008',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.667031] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.667031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.667031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.667031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.667031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.667031] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 668a09a1-427d-4507-b7d0-45cab066cac8 not found, creating... [ 623.667031] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.667031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.667031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.667491] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.667491] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.667659] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.667817] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.667931] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.668289] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.668463] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.668614] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 668a09a1-427d-4507-b7d0-45cab066cac8 is going to be created. [ 623.692059] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.692059] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.692059] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.692059] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.692059] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.692059] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-668a09a1-427d-4507-b7d0-45cab066cac8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.696918] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.697087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.697160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.697336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.697421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.697504] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d635d2b-1797-4206-b032-b7450c1074bc is going to be updated. [ 623.730861] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.731024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.731128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.731310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.731452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.741725] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: IN_PROGRESS for 2s [ 623.926393] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b11a855-bfed-439a-98dd-be76c02ee008 [ 623.926681] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.926824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.926891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.927153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.927233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.927330] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b11a855-bfed-439a-98dd-be76c02ee008 already deleted. [ 623.927406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b11a855-bfed-439a-98dd-be76c02ee008" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.943074] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-51937eab-f698-4810-a930-991c3d137450 service nova] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_rules [ 624.943486] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-51937eab-f698-4810-a930-991c3d137450 service nova] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 624.943486] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-51937eab-f698-4810-a930-991c3d137450 service nova] Enqueued Resource ID: 668a09a1-427d-4507-b7d0-45cab066cac8 with Priority: HIGHEST for action port [ 624.945482] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_rules [ 624.945482] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 624.945482] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 668a09a1-427d-4507-b7d0-45cab066cac8 with Priority: HIGHEST for action port [ 624.945482] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.945482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.945482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.945482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.945482] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.947928] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.947928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.947928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.948717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.948916] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.949583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.949583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.949583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.949583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.949583] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.950236] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-668a09a1-427d-4507-b7d0-45cab066cac8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.950353] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-668a09a1-427d-4507-b7d0-45cab066cac8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.951057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-668a09a1-427d-4507-b7d0-45cab066cac8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.951057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-668a09a1-427d-4507-b7d0-45cab066cac8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.951057] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('668a09a1-427d-4507-b7d0-45cab066cac8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.452916] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.452916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.453374] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 668a09a1-427d-4507-b7d0-45cab066cac8 with status ACTIVE [ 625.453541] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.453667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.453761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.453949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.454050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.454225] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.454334] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.454408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.454679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.454782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.455064] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.455202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.455268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.455439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.455536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.455624] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 668a09a1-427d-4507-b7d0-45cab066cac8 is going to be updated. [ 625.457459] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.517212] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.517482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.517560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.517901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.518151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.518495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-668a09a1-427d-4507-b7d0-45cab066cac8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.754631] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: SUCCESS [ 625.754631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.754631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.755110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.755279] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.755367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.755424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.755647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.755755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.755866] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.756485] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.961389] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.080939] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.083066] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-314" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.083066] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-314" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.083066] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-314" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.083066] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.083066] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.084143] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.084143] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.084143] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.084447] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 626.084609] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.084805] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.084924] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.085090] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 626.085256] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.085540] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.122650] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.122831] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 626.122973] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.123181] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-314" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.123532] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-a1cdb314-5a29-443e-8562-bced871a8df1 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.123785] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-a1cdb314-5a29-443e-8562-bced871a8df1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.123947] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-a1cdb314-5a29-443e-8562-bced871a8df1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.124361] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-a1cdb314-5a29-443e-8562-bced871a8df1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.124460] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1cdb314-5a29-443e-8562-bced871a8df1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.258876] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.259124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.259208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.259583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.259839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.259967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.262609] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.262609] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.262609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.262609] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.468453] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.470513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.470513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.470513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.471175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.471175] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be created. [ 626.497511] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.497661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.497739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.497954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.498133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.509954] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: UNINITIALIZED for 2s [ 626.627465] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.627636] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.627755] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.628070] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.628219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.628427] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port a1cdb314-5a29-443e-8562-bced871a8df1 not found, creating... [ 626.628687] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.628845] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.628961] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.629188] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.629319] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.629620] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.629783] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.629899] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.630399] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.630648] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.630719] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: a1cdb314-5a29-443e-8562-bced871a8df1 is going to be created. [ 626.655948] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.656215] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.656329] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.656701] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.656932] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.657182] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-a1cdb314-5a29-443e-8562-bced871a8df1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.765238] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d635d2b-1797-4206-b032-b7450c1074bc: rpc.has_security_group_logging(os_id): False [ 626.785889] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.786098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.786870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.787240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.787368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.787676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.787734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.787782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.787966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.788750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.789154] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.789289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.789382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.789637] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.789730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.789939] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.790055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.790130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.790343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.790457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.790803] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d635d2b-1797-4206-b032-b7450c1074bc is going to be updated. [ 626.863560] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.863695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.863731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.863929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.864095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.880916] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: IN_PROGRESS for 2s [ 628.287149] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-6276a3df-d8f4-4a7d-9521-f93a10ac9357 service nova] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_rules [ 628.291472] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-6276a3df-d8f4-4a7d-9521-f93a10ac9357 service nova] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 628.291472] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-6276a3df-d8f4-4a7d-9521-f93a10ac9357 service nova] Enqueued Resource ID: a1cdb314-5a29-443e-8562-bced871a8df1 with Priority: HIGHEST for action port [ 628.291472] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_rules [ 628.291472] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 628.291472] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cdb314-5a29-443e-8562-bced871a8df1 with Priority: HIGHEST for action port [ 628.291472] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.292801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.293241] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.293543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.294771] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1cdb314-5a29-443e-8562-bced871a8df1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.294771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1cdb314-5a29-443e-8562-bced871a8df1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.294771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1cdb314-5a29-443e-8562-bced871a8df1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.294771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1cdb314-5a29-443e-8562-bced871a8df1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.294771] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1cdb314-5a29-443e-8562-bced871a8df1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.520365] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 628.520643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.520854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.521506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.521506] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.521506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.521506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.521784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.521784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.521784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.521934] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.523682] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.523682] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.523902] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.525709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.525709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.525709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.525709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.525709] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.797679] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1cdb314-5a29-443e-8562-bced871a8df1 with status ACTIVE [ 628.797967] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.798093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.798269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.798424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.798547] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.798701] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.798928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.798928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.799220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.799220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.799363] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.799363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.799559] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.799611] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.799716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.799755] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1cdb314-5a29-443e-8562-bced871a8df1 is going to be updated. [ 628.823463] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.823781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.823897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.824169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.824364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.824625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1cdb314-5a29-443e-8562-bced871a8df1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.900989] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: SUCCESS [ 628.901300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.027728] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.028034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 629.032440] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.536444] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.011070] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-235 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.011652] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-235" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.012151] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-235" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.012547] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-235" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.012969] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.013367] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.013590] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.013926] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.014187] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.014503] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 630.014806] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.016141] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.016423] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.016665] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 630.016880] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.017124] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.040389] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.043025] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 630.043025] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.043025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-235" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.043025] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-a2583c61-5b1a-4a33-8206-4f81fca1b131 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.043025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-a2583c61-5b1a-4a33-8206-4f81fca1b131" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.043025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-a2583c61-5b1a-4a33-8206-4f81fca1b131" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.043025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-a2583c61-5b1a-4a33-8206-4f81fca1b131" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.043025] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2583c61-5b1a-4a33-8206-4f81fca1b131',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.044347] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.044719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.044894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.045198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.045378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.045553] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 630.108526] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.108526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.108526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.108526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.108526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.117775] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 630.193508] env[62909]: INFO networking_nsxv3.common.synchronization [req-24c14aa3-9047-4c89-9a40-9714f14efb68 req-49bc2d13-23f2-4207-a3fa-eb2a29873c0d tempest-ServerTagsTestJSON-331705066 tempest-ServerTagsTestJSON-331705066-project-member] Enqueued Resource ID: d6981999-a42c-4650-befd-1111c3f609ec with Priority: HIGHEST for action security_group_members [ 630.194122] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6981999-a42c-4650-befd-1111c3f609ec with Priority: HIGHEST for action security_group_members [ 630.194485] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6981999-a42c-4650-befd-1111c3f609ec taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.194765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.194833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.196560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.196788] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.197222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.197222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.197222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.197381] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.197381] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6981999-a42c-4650-befd-1111c3f609ec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.549416] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.550747] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.550747] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.551686] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.551686] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.551833] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port a2583c61-5b1a-4a33-8206-4f81fca1b131 not found, creating... [ 630.552171] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.552477] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.552616] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.553314] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.553314] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.553500] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.553674] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.553794] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.554023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.554158] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.554305] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: a2583c61-5b1a-4a33-8206-4f81fca1b131 is going to be created. [ 630.579342] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.579698] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.579888] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.580202] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.581038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.581038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-a2583c61-5b1a-4a33-8206-4f81fca1b131" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.700031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.700031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.700031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.700311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.700311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.700528] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.700703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.700703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.700903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.701020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.701152] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6981999-a42c-4650-befd-1111c3f609ec already deleted. [ 630.701417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 630.831772] env[62909]: INFO networking_nsxv3.common.synchronization [None req-be3e4d21-6d4f-43d1-94ef-d46b04cf5b9c None None] Enqueued Resource ID: dea9c525-7205-4891-8b35-1a7a6bcb9acd with Priority: HIGHEST for action port [ 630.832459] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea9c525-7205-4891-8b35-1a7a6bcb9acd with Priority: HIGHEST for action port [ 630.834676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-dea9c525-7205-4891-8b35-1a7a6bcb9acd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.834676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dea9c525-7205-4891-8b35-1a7a6bcb9acd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 630.834676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dea9c525-7205-4891-8b35-1a7a6bcb9acd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.834676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dea9c525-7205-4891-8b35-1a7a6bcb9acd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 630.834676] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dea9c525-7205-4891-8b35-1a7a6bcb9acd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.338502] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dea9c525-7205-4891-8b35-1a7a6bcb9acd [ 631.338774] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.338998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 631.339088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.339320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.339404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.339565] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dea9c525-7205-4891-8b35-1a7a6bcb9acd already deleted. [ 631.339720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dea9c525-7205-4891-8b35-1a7a6bcb9acd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.625572] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-118 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.625572] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-118" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 631.625572] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-118" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.625922] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-118" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.628779] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.629036] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 631.630487] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.630487] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.630487] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.630487] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 631.630487] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.630487] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.630487] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.630487] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 631.630848] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.630848] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.653156] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.653156] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 631.653660] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.653660] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-118" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.654100] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-510995e6-4d3c-4b63-ae4e-d4c1f74254e8 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.654344] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-510995e6-4d3c-4b63-ae4e-d4c1f74254e8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 631.654468] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-510995e6-4d3c-4b63-ae4e-d4c1f74254e8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.654806] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-510995e6-4d3c-4b63-ae4e-d4c1f74254e8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.654904] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('510995e6-4d3c-4b63-ae4e-d4c1f74254e8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.910802] env[62909]: INFO networking_nsxv3.common.synchronization [req-c111105e-e641-437e-9d10-7ce36871bf7a req-a2cf3847-ac14-4b32-bd02-0b53243299e4 tempest-ServerActionsTestOtherB-1631848678 tempest-ServerActionsTestOtherB-1631848678-project-member] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 631.914660] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 631.914660] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.914660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 631.914660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.914660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.914660] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.914660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 631.914660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.914660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.914660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.914660] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.130222] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 632.130439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.130611] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.130833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.131344] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.131466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.132232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.132435] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.132523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.132614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.132784] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.132879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.132940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.133231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.133311] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.133375] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.133468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.133985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.133985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.133985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.133985] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.161379] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.161379] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.161379] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.161379] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.161379] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.161379] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 510995e6-4d3c-4b63-ae4e-d4c1f74254e8 not found, creating... [ 632.161379] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.161379] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.161379] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.161379] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.161379] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.162222] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.162666] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.163702] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.163702] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.164186] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.164502] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 510995e6-4d3c-4b63-ae4e-d4c1f74254e8 is going to be created. [ 632.168102] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-218c2c27-0c19-4ca4-8b3b-eecdf7561919 service nova] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_rules [ 632.168397] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-218c2c27-0c19-4ca4-8b3b-eecdf7561919 service nova] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 632.171025] env[62909]: INFO networking_nsxv3.common.synchronization [req-79c97665-854b-484a-83ad-aba7db2e6067 req-218c2c27-0c19-4ca4-8b3b-eecdf7561919 service nova] Enqueued Resource ID: a2583c61-5b1a-4a33-8206-4f81fca1b131 with Priority: HIGHEST for action port [ 632.171025] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_rules [ 632.171025] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 632.171025] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2583c61-5b1a-4a33-8206-4f81fca1b131 with Priority: HIGHEST for action port [ 632.171025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.171025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.171025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.171025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.171025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.171025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.173084] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.173084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.173084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.173084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.173084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.173084] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.174430] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2583c61-5b1a-4a33-8206-4f81fca1b131 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.174430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2583c61-5b1a-4a33-8206-4f81fca1b131" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.174430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2583c61-5b1a-4a33-8206-4f81fca1b131" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.174430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2583c61-5b1a-4a33-8206-4f81fca1b131" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.174430] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2583c61-5b1a-4a33-8206-4f81fca1b131',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.189100] env[62909]: INFO networking_nsxv3.common.synchronization [None req-1f535e7e-f6bc-4660-a0ac-08ce290089dc None None] Enqueued Resource ID: 4afbe8ea-8c7f-4230-be67-218ebb1a598d with Priority: HIGHEST for action port [ 632.190484] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.190742] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.190880] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.192086] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.192086] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.192086] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-510995e6-4d3c-4b63-ae4e-d4c1f74254e8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.193497] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4afbe8ea-8c7f-4230-be67-218ebb1a598d with Priority: HIGHEST for action port [ 632.193497] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-4afbe8ea-8c7f-4230-be67-218ebb1a598d taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.193497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4afbe8ea-8c7f-4230-be67-218ebb1a598d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.193497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4afbe8ea-8c7f-4230-be67-218ebb1a598d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.193497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4afbe8ea-8c7f-4230-be67-218ebb1a598d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.193799] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4afbe8ea-8c7f-4230-be67-218ebb1a598d',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.417346] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.417526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.417618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.417886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.417979] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.418194] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.418293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.418368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.419083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.419083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.419083] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a already deleted. [ 632.419083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.637420] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae9364a2-033c-455a-b65c-755fec76be27: rpc.has_security_group_logging(os_id): False [ 632.661238] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.661238] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.661238] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.661238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.663157] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.663303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.663387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.663583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.663671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.663813] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be created. [ 632.676158] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.679020] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2583c61-5b1a-4a33-8206-4f81fca1b131 with status ACTIVE [ 632.679020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.679020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.679020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.679020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.679431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.679431] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.679431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.679553] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.679603] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.679691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.680977] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.680977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.680977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.681206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.681319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.681582] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2583c61-5b1a-4a33-8206-4f81fca1b131 is going to be updated. [ 632.696029] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4afbe8ea-8c7f-4230-be67-218ebb1a598d [ 632.696029] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.696029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.696029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.696029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.696029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.696335] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4afbe8ea-8c7f-4230-be67-218ebb1a598d already deleted. [ 632.696335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4afbe8ea-8c7f-4230-be67-218ebb1a598d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.704388] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.704520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.704576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.705511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.705511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.705511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2583c61-5b1a-4a33-8206-4f81fca1b131" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.741081] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.741081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.741081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.741081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.741081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.759526] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 632.800250] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.800459] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.800550] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.800886] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.801716] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.801716] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.801716] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.801716] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.801931] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.802113] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 632.802439] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.802439] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.802439] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.802587] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 632.802587] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.802708] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.850262] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.850467] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 632.850597] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.850861] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.851287] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-1c22c510-e137-4ee3-8038-3b784a81e04f taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.851457] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-1c22c510-e137-4ee3-8038-3b784a81e04f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.851578] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-1c22c510-e137-4ee3-8038-3b784a81e04f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.852258] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-1c22c510-e137-4ee3-8038-3b784a81e04f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.852359] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c22c510-e137-4ee3-8038-3b784a81e04f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.937651] env[62909]: INFO networking_nsxv3.common.synchronization [req-96e95ec9-795c-434d-b3f0-7cf30659992c req-418946b0-7d1a-4de8-9fb8-dca5fd5149fe tempest-ServerExternalEventsTest-1328511746 tempest-ServerExternalEventsTest-1328511746-project-member] Enqueued Resource ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 with Priority: HIGHEST for action security_group_members [ 632.938239] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 with Priority: HIGHEST for action security_group_members [ 632.938466] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7554444-3d48-4fef-b5ad-54687b70bfc1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.938620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.938688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.938886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.940219] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.940362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.940444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.940664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.940953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.943774] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7554444-3d48-4fef-b5ad-54687b70bfc1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.180372] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.359030] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.359030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.359030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.359030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.359030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.359030] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 1c22c510-e137-4ee3-8038-3b784a81e04f not found, creating... [ 633.359030] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.359030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.359030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.359030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.359030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.359743] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.360080] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.360331] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.360643] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.361095] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.361348] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 1c22c510-e137-4ee3-8038-3b784a81e04f is going to be created. [ 633.385964] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.387973] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.387973] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.387973] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.387973] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.387973] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-1c22c510-e137-4ee3-8038-3b784a81e04f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.445834] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.449027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.449027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.449027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.449027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.449027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.449027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.449027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.449027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.449027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.449027] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 is going to be updated. [ 633.491020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.491020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.491020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.491020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.491020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.508767] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 in Status: IN_PROGRESS for 2s [ 633.682900] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.683253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.684211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.684589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.687377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.687553] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 633.719270] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.719472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.719472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.719821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.719821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.729825] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 633.814738] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e5f6ab27-8680-4400-a95e-6af5b394a7b4 None None] Enqueued Resource ID: 950c07e2-d223-4a81-9222-55df6bb18bcf with Priority: HIGHEST for action port [ 633.814842] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 950c07e2-d223-4a81-9222-55df6bb18bcf with Priority: HIGHEST for action port [ 633.815475] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-950c07e2-d223-4a81-9222-55df6bb18bcf taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.815564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-950c07e2-d223-4a81-9222-55df6bb18bcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.815662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-950c07e2-d223-4a81-9222-55df6bb18bcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.815858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-950c07e2-d223-4a81-9222-55df6bb18bcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.815943] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('950c07e2-d223-4a81-9222-55df6bb18bcf',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.935884] env[62909]: INFO networking_nsxv3.common.synchronization [req-24c14aa3-9047-4c89-9a40-9714f14efb68 req-b2a27845-5e01-425a-b6f9-7fed02186695 service nova] Enqueued Resource ID: d6981999-a42c-4650-befd-1111c3f609ec with Priority: HIGHEST for action security_group_rules [ 633.936085] env[62909]: INFO networking_nsxv3.common.synchronization [req-24c14aa3-9047-4c89-9a40-9714f14efb68 req-b2a27845-5e01-425a-b6f9-7fed02186695 service nova] Enqueued Resource ID: d6981999-a42c-4650-befd-1111c3f609ec with Priority: HIGHEST for action security_group_members [ 633.936287] env[62909]: INFO networking_nsxv3.common.synchronization [req-24c14aa3-9047-4c89-9a40-9714f14efb68 req-b2a27845-5e01-425a-b6f9-7fed02186695 service nova] Enqueued Resource ID: 510995e6-4d3c-4b63-ae4e-d4c1f74254e8 with Priority: HIGHEST for action port [ 633.936859] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6981999-a42c-4650-befd-1111c3f609ec with Priority: HIGHEST for action security_group_rules [ 633.937396] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6981999-a42c-4650-befd-1111c3f609ec with Priority: HIGHEST for action security_group_members [ 633.937499] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510995e6-4d3c-4b63-ae4e-d4c1f74254e8 with Priority: HIGHEST for action port [ 633.937821] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6981999-a42c-4650-befd-1111c3f609ec taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.937984] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.938085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.938402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.938464] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6981999-a42c-4650-befd-1111c3f609ec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.940593] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6981999-a42c-4650-befd-1111c3f609ec taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.943184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.943184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.943184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.943184] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.943184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.943184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.943184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.943184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.943184] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6981999-a42c-4650-befd-1111c3f609ec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.944461] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-510995e6-4d3c-4b63-ae4e-d4c1f74254e8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.944461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-510995e6-4d3c-4b63-ae4e-d4c1f74254e8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.944461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-510995e6-4d3c-4b63-ae4e-d4c1f74254e8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.944461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-510995e6-4d3c-4b63-ae4e-d4c1f74254e8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.944461] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('510995e6-4d3c-4b63-ae4e-d4c1f74254e8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.320544] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 950c07e2-d223-4a81-9222-55df6bb18bcf [ 634.320544] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.320544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.320544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.320544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.320544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.320544] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:950c07e2-d223-4a81-9222-55df6bb18bcf already deleted. [ 634.320544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-950c07e2-d223-4a81-9222-55df6bb18bcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.446867] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6981999-a42c-4650-befd-1111c3f609ec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.447505] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6981999-a42c-4650-befd-1111c3f609ec taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.447635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.448448] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 510995e6-4d3c-4b63-ae4e-d4c1f74254e8 with status ACTIVE [ 634.448762] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.448861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.448909] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.449221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.449287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.449471] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.449566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.449625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.450147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.450147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.450147] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.450585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.450585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.450585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.450585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.450585] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 510995e6-4d3c-4b63-ae4e-d4c1f74254e8 is going to be updated. [ 634.484902] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.484902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.484902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.484902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.484902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.484902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-510995e6-4d3c-4b63-ae4e-d4c1f74254e8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.558169] env[62909]: INFO networking_nsxv3.common.synchronization [req-c111105e-e641-437e-9d10-7ce36871bf7a req-bead23f6-edd3-4371-9976-28b148211a3b service nova] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 634.559229] env[62909]: INFO networking_nsxv3.common.synchronization [req-c111105e-e641-437e-9d10-7ce36871bf7a req-bead23f6-edd3-4371-9976-28b148211a3b service nova] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 634.559229] env[62909]: INFO networking_nsxv3.common.synchronization [req-c111105e-e641-437e-9d10-7ce36871bf7a req-bead23f6-edd3-4371-9976-28b148211a3b service nova] Enqueued Resource ID: 1c22c510-e137-4ee3-8038-3b784a81e04f with Priority: HIGHEST for action port [ 634.559229] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 634.559229] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 634.559229] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c22c510-e137-4ee3-8038-3b784a81e04f with Priority: HIGHEST for action port [ 634.559499] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.559642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.559642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.560694] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.560694] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.565967] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.566117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.566176] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.566369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.566564] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.566668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.566780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.566878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.566960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.567063] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.567911] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c22c510-e137-4ee3-8038-3b784a81e04f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.568070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c22c510-e137-4ee3-8038-3b784a81e04f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.570573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c22c510-e137-4ee3-8038-3b784a81e04f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.570573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c22c510-e137-4ee3-8038-3b784a81e04f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.570573] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c22c510-e137-4ee3-8038-3b784a81e04f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.775282] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 634.777431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.777431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.777431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.777431] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.783691] env[62909]: INFO networking_nsxv3.common.synchronization [req-0dfd2ac8-53eb-46c5-b91a-52337ef496f6 req-eea2d17d-7b0a-4de4-9806-46c8f2fdf611 tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 634.783691] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 634.783883] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.784030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.784030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.784479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.785349] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.785412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.785627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.785875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.785973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.786292] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.950201] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6981999-a42c-4650-befd-1111c3f609ec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.075023] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.075023] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.075023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.075023] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c22c510-e137-4ee3-8038-3b784a81e04f with status ACTIVE [ 635.075023] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.075023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.075023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.075023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.075023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.075023] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.075023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.075023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.075023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.075023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.081509] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.081685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.081767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.081992] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.082100] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.082208] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c22c510-e137-4ee3-8038-3b784a81e04f is going to be updated. [ 635.106846] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.109922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.109922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.109922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.109922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.109922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c22c510-e137-4ee3-8038-3b784a81e04f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.189471] env[62909]: INFO networking_nsxv3.common.synchronization [None req-4f001b15-24bf-4f7d-b1ac-fb38e755aa65 None None] Enqueued Resource ID: 62d8d07e-f1d2-4a44-94ab-43afcb51d193 with Priority: HIGHEST for action port [ 635.192730] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62d8d07e-f1d2-4a44-94ab-43afcb51d193 with Priority: HIGHEST for action port [ 635.192730] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-62d8d07e-f1d2-4a44-94ab-43afcb51d193 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.192730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62d8d07e-f1d2-4a44-94ab-43afcb51d193" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.192730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62d8d07e-f1d2-4a44-94ab-43afcb51d193" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.193092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62d8d07e-f1d2-4a44-94ab-43afcb51d193" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.193092] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62d8d07e-f1d2-4a44-94ab-43afcb51d193',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.279641] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.279878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.288339] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.288598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.288714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.288997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.289683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.289683] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.289683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.289683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.290048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.290048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.290048] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f already deleted. [ 635.290048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.454067] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.454067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.454067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.454067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.454067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.454067] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6981999-a42c-4650-befd-1111c3f609ec is going to be created. [ 635.482907] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.483080] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.483135] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.486027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.486027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.496935] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6981999-a42c-4650-befd-1111c3f609ec in Status: UNINITIALIZED for 2s [ 635.573432] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 in Status: SUCCESS [ 635.573647] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 deletion is rescheduled due to dependency. [ 635.573736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.584297] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.697181] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62d8d07e-f1d2-4a44-94ab-43afcb51d193 [ 635.697333] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.697401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.697490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.697693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.697778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.697963] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62d8d07e-f1d2-4a44-94ab-43afcb51d193 already deleted. [ 635.697963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62d8d07e-f1d2-4a44-94ab-43afcb51d193" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.742979] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 635.743222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.743476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.743599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.744326] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.744326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.744326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.744326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.744326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.744326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.744616] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.791077] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.791398] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.791398] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.791795] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.792685] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.792928] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.793305] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.793566] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.794164] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.794405] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 635.794519] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.794630] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.794735] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.795178] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 635.795489] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.796563] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.817906] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.820260] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 635.820260] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.820460] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.821090] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-90cb4968-f2bd-4e77-9d1a-d66dcdf73599 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.821291] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-90cb4968-f2bd-4e77-9d1a-d66dcdf73599" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.821772] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-90cb4968-f2bd-4e77-9d1a-d66dcdf73599" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.821876] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-90cb4968-f2bd-4e77-9d1a-d66dcdf73599" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.821988] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90cb4968-f2bd-4e77-9d1a-d66dcdf73599',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.087242] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.087242] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.087242] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.087242] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.087761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.088863] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be created. [ 636.147410] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.147410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.147410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.147410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.147410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.162398] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: UNINITIALIZED for 2s [ 636.246684] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.246851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.247407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.247407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.247407] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.247598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.247598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.247709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.247800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.247903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.248072] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.248182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.248244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.248408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.248643] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.248777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.248829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.248963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.249072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.249172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.249968] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.328906] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.328906] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.328906] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.328906] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.331859] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.331859] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 90cb4968-f2bd-4e77-9d1a-d66dcdf73599 not found, creating... [ 636.331859] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.331859] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.331859] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.334089] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.334089] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.334089] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.334089] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.334089] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.334089] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.334089] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.334089] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 90cb4968-f2bd-4e77-9d1a-d66dcdf73599 is going to be created. [ 636.371847] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.372317] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.372317] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.372490] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.372945] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.372945] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-90cb4968-f2bd-4e77-9d1a-d66dcdf73599" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.752293] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae9364a2-033c-455a-b65c-755fec76be27: rpc.has_security_group_logging(os_id): False [ 636.775064] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.775249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.775294] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.775583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.775710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.775914] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.776061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.776196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.776327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.776399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.776637] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.776751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.776801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.776931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.776999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.777524] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.777788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.777788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.778159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.778291] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.778422] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 636.857942] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.858324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.858324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.858987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.859192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.874427] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 637.508734] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6981999-a42c-4650-befd-1111c3f609ec in Status: SUCCESS [ 637.508969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.509381] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.509454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.509666] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.512505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.512635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.512949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.513075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.513292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.513426] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6981999-a42c-4650-befd-1111c3f609ec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.732387] env[62909]: INFO networking_nsxv3.common.synchronization [req-0dfd2ac8-53eb-46c5-b91a-52337ef496f6 req-f88f241d-c3df-498c-b09a-f7d311258a50 service nova] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_rules [ 637.732387] env[62909]: INFO networking_nsxv3.common.synchronization [req-0dfd2ac8-53eb-46c5-b91a-52337ef496f6 req-f88f241d-c3df-498c-b09a-f7d311258a50 service nova] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 637.732523] env[62909]: INFO networking_nsxv3.common.synchronization [req-0dfd2ac8-53eb-46c5-b91a-52337ef496f6 req-f88f241d-c3df-498c-b09a-f7d311258a50 service nova] Enqueued Resource ID: 90cb4968-f2bd-4e77-9d1a-d66dcdf73599 with Priority: HIGHEST for action port [ 637.734384] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_rules [ 637.734384] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 637.734384] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90cb4968-f2bd-4e77-9d1a-d66dcdf73599 with Priority: HIGHEST for action port [ 637.735544] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ceae379b-32de-4002-a3af-adf0edf466be None None] Enqueued Resource ID: 48145be7-cfca-453c-b457-6b0c0fe704ab with Priority: HIGHEST for action port [ 637.735638] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.736803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.736803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.736803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.736803] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.737214] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.737280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.737774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.737774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.737774] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.738077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.738077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.738077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.738220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.738220] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.739618] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-90cb4968-f2bd-4e77-9d1a-d66dcdf73599 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.739618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90cb4968-f2bd-4e77-9d1a-d66dcdf73599" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.739618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90cb4968-f2bd-4e77-9d1a-d66dcdf73599" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.739618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90cb4968-f2bd-4e77-9d1a-d66dcdf73599" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.739618] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90cb4968-f2bd-4e77-9d1a-d66dcdf73599',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.740421] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48145be7-cfca-453c-b457-6b0c0fe704ab with Priority: HIGHEST for action port [ 637.741094] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-48145be7-cfca-453c-b457-6b0c0fe704ab taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.741196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48145be7-cfca-453c-b457-6b0c0fe704ab" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.741233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48145be7-cfca-453c-b457-6b0c0fe704ab" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.741436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48145be7-cfca-453c-b457-6b0c0fe704ab" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.741540] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48145be7-cfca-453c-b457-6b0c0fe704ab',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.020236] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6981999-a42c-4650-befd-1111c3f609ec taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.020236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.020236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.020236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.021053] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.021053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.021053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.021053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.021053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.021053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.021053] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6981999-a42c-4650-befd-1111c3f609ec taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.021574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.021574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.021574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.021574] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.021574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.021838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.021838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.021838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.021939] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.022745] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6981999-a42c-4650-befd-1111c3f609ec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.175737] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 638.175737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.176256] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.176483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.176668] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.176790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.176854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.177032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.177103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.177205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.177335] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.241763] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.241954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.242249] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90cb4968-f2bd-4e77-9d1a-d66dcdf73599 with status ACTIVE [ 638.242517] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.242705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.243268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.243268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.243383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.243589] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.243741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.243838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.244098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.244243] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.244503] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.244647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.244740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.244965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.247963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.247963] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90cb4968-f2bd-4e77-9d1a-d66dcdf73599 is going to be updated. [ 638.251279] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.251279] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48145be7-cfca-453c-b457-6b0c0fe704ab [ 638.251279] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.251279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.251279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.251279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.251279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.251279] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48145be7-cfca-453c-b457-6b0c0fe704ab already deleted. [ 638.251279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48145be7-cfca-453c-b457-6b0c0fe704ab" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.283232] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.283592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.283592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.283833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.283941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.284317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90cb4968-f2bd-4e77-9d1a-d66dcdf73599" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.525908] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6981999-a42c-4650-befd-1111c3f609ec: rpc.has_security_group_logging(os_id): False [ 638.555193] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.555193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.555442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.556045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.556045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.556045] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.556045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.556045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.556324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.556324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.556512] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.556629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.556687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.557230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.557230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.558663] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.558663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.558663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.558663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.558663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.558663] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6981999-a42c-4650-befd-1111c3f609ec is going to be created. [ 638.659093] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.659464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.659573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.659774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.659996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.681642] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6981999-a42c-4650-befd-1111c3f609ec in Status: IN_PROGRESS for 2s [ 638.681951] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.754171] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.899878] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 638.900081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.900690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.901187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.901187] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.186955] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23297eee-5815-4160-b6ed-90818fa0ab3a: rpc.has_security_group_logging(os_id): False [ 639.207401] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.207401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.207629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.207669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.207739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.207974] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.208206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.208206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.208295] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.208406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.208455] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be created. [ 639.260882] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.261482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.263788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.263788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.263788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.263788] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be created. [ 639.278285] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.278285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.278285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.278285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.278285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.289705] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 639.295278] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.296119] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.296119] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.296326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.296378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.314550] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: UNINITIALIZED for 2s [ 639.405576] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.405576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.405576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.405576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.406048] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.406444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.407813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.407813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.407813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.407813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.407813] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.912956] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.912956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.912956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.912956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.913283] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.913283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.913283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.913520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.913520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.913520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.913683] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.913763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.913763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.913891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.914074] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.914322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.914322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.914441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.914502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.914584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.914642] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.146089] env[62909]: INFO networking_nsxv3.common.synchronization [req-d1429961-d688-4e3c-bf91-96e7a3a5136d req-f123215d-ff56-4744-8c81-d52fe4da4004 tempest-DeleteServersAdminTestJSON-1896056451 tempest-DeleteServersAdminTestJSON-1896056451-project-member] Enqueued Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 640.146089] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 640.146089] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.146089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.147015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.147015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.147015] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.147015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.147015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.147333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.147333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.147408] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.418918] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae9364a2-033c-455a-b65c-755fec76be27: rpc.has_security_group_logging(os_id): False [ 640.441872] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.443890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.443890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.443890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.443890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.443890] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.443890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.443890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.443890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.443890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.444678] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.445483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.445483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.445483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.445483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.445779] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.445779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.445978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.446161] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.446294] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.446436] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 640.519354] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.519354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.519354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.519354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.519354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.551739] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 640.653446] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.653676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.653919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.654038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.654414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.654414] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.655651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.656283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.656283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.656422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.656611] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 is going to be updated. [ 640.694594] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.694594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.694594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.694847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.695277] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.698246] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6981999-a42c-4650-befd-1111c3f609ec in Status: SUCCESS [ 640.698246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.716242] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: IN_PROGRESS for 2s [ 640.956552] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.956829] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.956995] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.960527] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.960527] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.960527] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.960527] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.960527] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.960527] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.960527] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.960527] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.960527] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.960527] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.960527] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.960527] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.961436] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.986026] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.986026] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 640.986026] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.986026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.986026] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-e321d104-ea08-4f03-8274-e8ef45dc8952 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.986026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-e321d104-ea08-4f03-8274-e8ef45dc8952" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.986026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-e321d104-ea08-4f03-8274-e8ef45dc8952" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.986026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-e321d104-ea08-4f03-8274-e8ef45dc8952" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.986026] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e321d104-ea08-4f03-8274-e8ef45dc8952',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.305114] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 641.305114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.328027] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 641.328027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.328027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.328027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.328027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.328027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.328027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.328027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.328027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.328027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.328027] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.493138] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.493522] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.494163] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.494309] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.494662] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.494662] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port e321d104-ea08-4f03-8274-e8ef45dc8952 not found, creating... [ 641.495136] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.497431] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.497431] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.497431] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.497431] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.497431] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.497431] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.497431] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.499459] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.499459] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.499459] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: e321d104-ea08-4f03-8274-e8ef45dc8952 is going to be created. [ 641.524526] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.524810] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.524962] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.525299] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.525566] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.527853] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-e321d104-ea08-4f03-8274-e8ef45dc8952" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.832581] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.832901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.833041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.833619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.834192] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.836182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.836182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.836506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.837246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.837246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.837246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.837758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.837758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.838072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.839245] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.839245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.839245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.839245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.839245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.839245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.839245] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.030302] env[62909]: INFO networking_nsxv3.common.synchronization [None req-47427d56-f0eb-4844-a3ad-34fc7943a942 None None] Enqueued Resource ID: b5dd6271-6aa8-427f-b4d8-9d9f411b317e with Priority: HIGHEST for action port [ 642.031047] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5dd6271-6aa8-427f-b4d8-9d9f411b317e with Priority: HIGHEST for action port [ 642.031646] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5dd6271-6aa8-427f-b4d8-9d9f411b317e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.031807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5dd6271-6aa8-427f-b4d8-9d9f411b317e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.031907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5dd6271-6aa8-427f-b4d8-9d9f411b317e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.032212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5dd6271-6aa8-427f-b4d8-9d9f411b317e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.032321] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5dd6271-6aa8-427f-b4d8-9d9f411b317e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.342498] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f6e0db7-41ba-43f5-b841-2551ea96a39f: rpc.has_security_group_logging(os_id): False [ 642.363646] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.365697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.365697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.365697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.365697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.365697] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.365697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.365697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.365697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.365697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.366951] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.367388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.369475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.369475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.369475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.369475] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.369475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.369475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.369475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.374289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.374289] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be created. [ 642.440443] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.440648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.440648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.440980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.441180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.455114] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 642.535340] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5dd6271-6aa8-427f-b4d8-9d9f411b317e [ 642.536145] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.536145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.536486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.537396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.537396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.537396] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5dd6271-6aa8-427f-b4d8-9d9f411b317e already deleted. [ 642.537396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5dd6271-6aa8-427f-b4d8-9d9f411b317e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.568431] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 642.569736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.727303] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: SUCCESS [ 642.730575] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 deletion is rescheduled due to dependency. [ 642.730575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.880147] env[62909]: INFO networking_nsxv3.common.synchronization [req-d1429961-d688-4e3c-bf91-96e7a3a5136d req-d692e8ba-2af6-4008-b217-09308bc20bb6 service nova] Enqueued Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_rules [ 642.880321] env[62909]: INFO networking_nsxv3.common.synchronization [req-d1429961-d688-4e3c-bf91-96e7a3a5136d req-d692e8ba-2af6-4008-b217-09308bc20bb6 service nova] Enqueued Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 642.880456] env[62909]: INFO networking_nsxv3.common.synchronization [req-d1429961-d688-4e3c-bf91-96e7a3a5136d req-d692e8ba-2af6-4008-b217-09308bc20bb6 service nova] Enqueued Resource ID: e321d104-ea08-4f03-8274-e8ef45dc8952 with Priority: HIGHEST for action port [ 642.880679] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_rules [ 642.880808] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 642.880906] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e321d104-ea08-4f03-8274-e8ef45dc8952 with Priority: HIGHEST for action port [ 642.881440] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.881625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.881625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.881828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.881966] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.883977] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.884151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.884334] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.884449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.885420] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.885717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.885717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.885908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.886033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.886539] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.890200] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-e321d104-ea08-4f03-8274-e8ef45dc8952 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.890200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e321d104-ea08-4f03-8274-e8ef45dc8952" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.890200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e321d104-ea08-4f03-8274-e8ef45dc8952" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.890200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e321d104-ea08-4f03-8274-e8ef45dc8952" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.890200] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e321d104-ea08-4f03-8274-e8ef45dc8952',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.385351] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.385629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.391994] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e321d104-ea08-4f03-8274-e8ef45dc8952 with status ACTIVE [ 643.392239] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.392381] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.392441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.392897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.392897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.392897] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.393366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.393366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.393366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.393517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.393777] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.393913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.393968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.394364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.394443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.394491] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e321d104-ea08-4f03-8274-e8ef45dc8952 is going to be updated. [ 643.395804] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.419178] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.419436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.419436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.420296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.420296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.420296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e321d104-ea08-4f03-8274-e8ef45dc8952" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.834232] env[62909]: INFO networking_nsxv3.common.synchronization [None req-1647d388-1393-44c8-a568-88a23770f2ab None None] Enqueued Resource ID: b7e1d510-41a9-4fd9-9fff-e0283234c0ee with Priority: HIGHEST for action port [ 643.834629] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7e1d510-41a9-4fd9-9fff-e0283234c0ee with Priority: HIGHEST for action port [ 643.835092] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7e1d510-41a9-4fd9-9fff-e0283234c0ee taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.835254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7e1d510-41a9-4fd9-9fff-e0283234c0ee" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.835326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7e1d510-41a9-4fd9-9fff-e0283234c0ee" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.835586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7e1d510-41a9-4fd9-9fff-e0283234c0ee" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.835671] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7e1d510-41a9-4fd9-9fff-e0283234c0ee',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.899133] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.342471] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7e1d510-41a9-4fd9-9fff-e0283234c0ee [ 644.342832] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.346525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.346525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.346525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.346525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.346525] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7e1d510-41a9-4fd9-9fff-e0283234c0ee already deleted. [ 644.346525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7e1d510-41a9-4fd9-9fff-e0283234c0ee" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.401862] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.402120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.402182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.403026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.403026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.403952] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 is going to be updated. [ 644.454316] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.454544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.454544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.455602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.455602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.470681] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: IN_PROGRESS for 2s [ 644.475096] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 644.475261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.051201] env[62909]: INFO networking_nsxv3.common.synchronization [None req-09c3c709-89fe-4261-9320-f236fc5c9dfb None None] Enqueued Resource ID: 60534594-eae6-4a0b-9924-035424e2a01e with Priority: HIGHEST for action port [ 645.051791] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60534594-eae6-4a0b-9924-035424e2a01e with Priority: HIGHEST for action port [ 645.052597] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-60534594-eae6-4a0b-9924-035424e2a01e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.052778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60534594-eae6-4a0b-9924-035424e2a01e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.052778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60534594-eae6-4a0b-9924-035424e2a01e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.053107] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60534594-eae6-4a0b-9924-035424e2a01e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.053194] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60534594-eae6-4a0b-9924-035424e2a01e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.559097] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60534594-eae6-4a0b-9924-035424e2a01e [ 645.559203] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.559341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.559414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.559669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.559760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.559860] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60534594-eae6-4a0b-9924-035424e2a01e already deleted. [ 645.559945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60534594-eae6-4a0b-9924-035424e2a01e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.043184] env[62909]: INFO networking_nsxv3.common.synchronization [None req-dd226f65-b4cc-4991-bb06-1f7a926b26f3 None None] Enqueued Resource ID: bbe4e5e0-cbdf-44a4-b6d4-c9f453853bff with Priority: HIGHEST for action port [ 646.043421] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbe4e5e0-cbdf-44a4-b6d4-c9f453853bff with Priority: HIGHEST for action port [ 646.044116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbe4e5e0-cbdf-44a4-b6d4-c9f453853bff taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.044245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbe4e5e0-cbdf-44a4-b6d4-c9f453853bff" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.044318] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbe4e5e0-cbdf-44a4-b6d4-c9f453853bff" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.044593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbe4e5e0-cbdf-44a4-b6d4-c9f453853bff" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.044713] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbe4e5e0-cbdf-44a4-b6d4-c9f453853bff',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.484855] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: SUCCESS [ 646.484855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.485424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.485424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.485424] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.485424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.485781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.485781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.485781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.485927] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.485927] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.546848] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbe4e5e0-cbdf-44a4-b6d4-c9f453853bff [ 646.547882] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.548110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.548207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.548448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.548559] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.548690] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbe4e5e0-cbdf-44a4-b6d4-c9f453853bff already deleted. [ 646.548805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbe4e5e0-cbdf-44a4-b6d4-c9f453853bff" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.989250] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.989578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.989578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.989737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.989940] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.990113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.990113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.990325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.990325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.990506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.990506] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.990661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.990661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.990956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.990956] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.991201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.991201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.991201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.991409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.991409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.991409] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.494295] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11f84bbc-cc8c-4244-87ea-1493e7543f81: rpc.has_security_group_logging(os_id): False [ 647.517424] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.517644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.517749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.517988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.518150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.518372] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.518506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.518707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.518890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.519008] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.519287] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.519419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.519491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.519715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.519811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.520097] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.520208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.520344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.520480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.520584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.520692] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 is going to be updated. [ 647.598594] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.598877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.598959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.599229] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.599441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.614970] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: IN_PROGRESS for 2s [ 647.641814] env[62909]: INFO networking_nsxv3.common.synchronization [req-4fb4da67-3c10-40d0-89a4-a8dd6318b78c req-f6a3ffb9-288d-494a-bdba-c039aab44a47 tempest-TenantUsagesTestJSON-824276567 tempest-TenantUsagesTestJSON-824276567-project-member] Enqueued Resource ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb with Priority: HIGHEST for action security_group_members [ 647.642030] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb with Priority: HIGHEST for action security_group_members [ 647.643286] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-59435e15-2dcf-4317-816e-1fcd9a40b9fb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.643286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.643286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.643286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.643286] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.643286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.643286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.643650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.643650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.643650] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59435e15-2dcf-4317-816e-1fcd9a40b9fb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.971365] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.971365] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.971365] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.971365] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.971365] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.971365] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.971365] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.971365] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.971365] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.971365] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.971365] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.972151] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.974150] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.974150] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.974150] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.974150] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.977568] env[62909]: INFO networking_nsxv3.common.synchronization [None req-6f24cc47-c5d7-4b46-86be-300e58686e5f None None] Enqueued Resource ID: fb66b6db-5509-4737-ad73-afb2c481bc16 with Priority: HIGHEST for action port [ 647.982462] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb66b6db-5509-4737-ad73-afb2c481bc16 with Priority: HIGHEST for action port [ 647.982462] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb66b6db-5509-4737-ad73-afb2c481bc16 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.982649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb66b6db-5509-4737-ad73-afb2c481bc16" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.982649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb66b6db-5509-4737-ad73-afb2c481bc16" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.982806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb66b6db-5509-4737-ad73-afb2c481bc16" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.982903] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb66b6db-5509-4737-ad73-afb2c481bc16',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.004318] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.004318] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.004318] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.004318] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.004318] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.004318] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.004318] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.004318] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.004318] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.146294] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.146457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.147434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.147434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.147434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.147434] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.147665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.147665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.147751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.147787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.147971] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb already deleted. [ 648.147971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.486040] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb66b6db-5509-4737-ad73-afb2c481bc16 [ 648.486040] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.486040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.486040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.486040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.486040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.486040] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb66b6db-5509-4737-ad73-afb2c481bc16 already deleted. [ 648.486422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb66b6db-5509-4737-ad73-afb2c481bc16" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.508454] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.508825] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.508967] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.509952] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.510345] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.510345] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce not found, creating... [ 648.510589] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.510759] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.510898] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.511153] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.511429] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.511622] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.514243] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.514493] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.515250] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.515576] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.515841] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce is going to be created. [ 648.543647] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.543882] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.544062] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.544413] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.544609] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.544908] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.633989] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: SUCCESS [ 649.638018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.339618] env[62909]: INFO networking_nsxv3.common.synchronization [None req-47663ee3-1417-4d4a-9e72-8068b147ee37 tempest-ServersTestManualDisk-1910117612 tempest-ServersTestManualDisk-1910117612-project-member] Enqueued Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_rules [ 650.340872] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_rules [ 650.340872] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35857353-01c5-40e5-800e-946a46ca0fc9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.341301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.341301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.341498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.341498] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.421220] env[62909]: INFO networking_nsxv3.common.synchronization [req-4fb4da67-3c10-40d0-89a4-a8dd6318b78c req-dc9f317f-f879-40a5-b14d-61001e87cb0f service nova] Enqueued Resource ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb with Priority: HIGHEST for action security_group_rules [ 650.421397] env[62909]: INFO networking_nsxv3.common.synchronization [req-4fb4da67-3c10-40d0-89a4-a8dd6318b78c req-dc9f317f-f879-40a5-b14d-61001e87cb0f service nova] Enqueued Resource ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb with Priority: HIGHEST for action security_group_members [ 650.421535] env[62909]: INFO networking_nsxv3.common.synchronization [req-4fb4da67-3c10-40d0-89a4-a8dd6318b78c req-dc9f317f-f879-40a5-b14d-61001e87cb0f service nova] Enqueued Resource ID: 0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce with Priority: HIGHEST for action port [ 650.424754] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb with Priority: HIGHEST for action security_group_rules [ 650.424754] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb with Priority: HIGHEST for action security_group_members [ 650.424754] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce with Priority: HIGHEST for action port [ 650.424754] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59435e15-2dcf-4317-816e-1fcd9a40b9fb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.424754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.424754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.424754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.424754] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59435e15-2dcf-4317-816e-1fcd9a40b9fb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.424754] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-59435e15-2dcf-4317-816e-1fcd9a40b9fb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.424754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.425150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.426988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.426988] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.426988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.426988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.426988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.426988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.426988] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59435e15-2dcf-4317-816e-1fcd9a40b9fb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.426988] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.427651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.427651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.427651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.427985] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.597900] env[62909]: INFO networking_nsxv3.common.synchronization [None req-d9ed730e-6084-40b3-b9d0-703526b0c299 tempest-ServersTestManualDisk-1910117612 tempest-ServersTestManualDisk-1910117612-project-member] Enqueued Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_rules [ 650.597900] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_rules [ 650.597900] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35857353-01c5-40e5-800e-946a46ca0fc9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.597900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.648937] env[62909]: INFO networking_nsxv3.common.synchronization [req-edb656af-bad9-4d4e-9681-d8fe83744393 req-7bacb95c-4a91-4f35-bbf4-a8e8644549b9 tempest-ServerRescueTestJSON-1768795781 tempest-ServerRescueTestJSON-1768795781-project-member] Enqueued Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 650.650854] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 650.651763] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.653061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.653061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.653281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.654119] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.654524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.654794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.655245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.656098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.656098] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.866694] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.866862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.866862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.867101] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.870646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.870646] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35857353-01c5-40e5-800e-946a46ca0fc9 already deleted. [ 650.870646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.870893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.870963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.871085] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.933862] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-59435e15-2dcf-4317-816e-1fcd9a40b9fb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.933862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.933862] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59435e15-2dcf-4317-816e-1fcd9a40b9fb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.933862] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce with status ACTIVE [ 650.933862] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.933862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.933862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.934363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.934363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.934725] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.934725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.934725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.934885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.934885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.935021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.935110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.935173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.935673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.935673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.935673] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce is going to be updated. [ 650.959946] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.959946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.959946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.959946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.959946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.959946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bb7c6b3-8c55-48e5-9a15-6c4eb11009ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.159928] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.160150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.160287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.160666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.160746] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.161019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.161165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.161207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.165630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.165630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.165630] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d09a74b6-7c94-44f4-afba-b179607452eb already deleted. [ 651.165630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.325032] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.325226] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-811" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.325364] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-811" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.325759] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-811" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.326119] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.329515] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.330201] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.330201] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.330349] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.330727] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.330727] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.330858] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.330898] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.332058] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.332058] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.332058] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.353722] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.353722] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.353722] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.353722] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-811" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.353722] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-e42f6371-f854-4e39-ae20-c78d59217dbb taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.353722] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-e42f6371-f854-4e39-ae20-c78d59217dbb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.353722] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-e42f6371-f854-4e39-ae20-c78d59217dbb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.353722] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-e42f6371-f854-4e39-ae20-c78d59217dbb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.353722] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e42f6371-f854-4e39-ae20-c78d59217dbb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.396578] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.396880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.396880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.397556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.397556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.397556] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35857353-01c5-40e5-800e-946a46ca0fc9 already deleted. [ 651.397556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.438037] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59435e15-2dcf-4317-816e-1fcd9a40b9fb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.857029] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.860746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.860746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.860746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.860746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.860746] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port e42f6371-f854-4e39-ae20-c78d59217dbb not found, creating... [ 651.860746] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.860746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.860746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.860746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.860746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.861589] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.863454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.863454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.863454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.863454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.863454] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: e42f6371-f854-4e39-ae20-c78d59217dbb is going to be created. [ 651.904722] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.904722] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.904722] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.905298] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.905707] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.909248] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-e42f6371-f854-4e39-ae20-c78d59217dbb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.944050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.944050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.944050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.944050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.944050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.944050] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb is going to be created. [ 651.975784] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.975784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.975784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.975784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.975784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.992174] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb in Status: UNINITIALIZED for 2s [ 652.930915] env[62909]: INFO networking_nsxv3.common.synchronization [req-22abf417-8663-4264-b811-78ab76c10afe req-3031c4d1-87e9-46bb-85c9-1ebfa3dd86a2 tempest-ServersWithSpecificFlavorTestJSON-184799251 tempest-ServersWithSpecificFlavorTestJSON-184799251-project-member] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 652.931520] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 652.931812] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.932049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.932049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.933870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.933870] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.934170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.934170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.936250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.936359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.936533] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.442143] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.442408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.442509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.442770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.442770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.442970] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.443080] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.443166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.443303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.443395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.443449] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 is going to be updated. [ 653.479019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.479257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.479257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.479638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.479638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.495060] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: IN_PROGRESS for 2s [ 653.620309] env[62909]: INFO networking_nsxv3.common.synchronization [req-edb656af-bad9-4d4e-9681-d8fe83744393 req-89e670df-c6e4-49a9-9ca9-42e429973511 service nova] Enqueued Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_rules [ 653.620309] env[62909]: INFO networking_nsxv3.common.synchronization [req-edb656af-bad9-4d4e-9681-d8fe83744393 req-89e670df-c6e4-49a9-9ca9-42e429973511 service nova] Enqueued Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 653.620450] env[62909]: INFO networking_nsxv3.common.synchronization [req-edb656af-bad9-4d4e-9681-d8fe83744393 req-89e670df-c6e4-49a9-9ca9-42e429973511 service nova] Enqueued Resource ID: e42f6371-f854-4e39-ae20-c78d59217dbb with Priority: HIGHEST for action port [ 653.621359] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_rules [ 653.621359] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 653.624192] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42f6371-f854-4e39-ae20-c78d59217dbb with Priority: HIGHEST for action port [ 653.624192] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.624192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.624192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.624192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.624192] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.624557] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.624704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.624776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.624902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.625073] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.625153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.625211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.625356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.625440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.625531] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.627288] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-e42f6371-f854-4e39-ae20-c78d59217dbb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.627288] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e42f6371-f854-4e39-ae20-c78d59217dbb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.627288] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e42f6371-f854-4e39-ae20-c78d59217dbb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.627613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e42f6371-f854-4e39-ae20-c78d59217dbb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.627613] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e42f6371-f854-4e39-ae20-c78d59217dbb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.893953] env[62909]: INFO networking_nsxv3.common.synchronization [req-1224c3c5-9a41-407f-80f5-a3ec372f0a0e req-3414d925-bac7-446e-af92-0a31b2429d4c tempest-FloatingIPsAssociationNegativeTestJSON-815623881 tempest-FloatingIPsAssociationNegativeTestJSON-815623881-project-member] Enqueued Resource ID: ba398af1-904a-41aa-b098-1f2b15a308ac with Priority: HIGHEST for action security_group_members [ 653.894511] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba398af1-904a-41aa-b098-1f2b15a308ac with Priority: HIGHEST for action security_group_members [ 653.894813] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba398af1-904a-41aa-b098-1f2b15a308ac taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.894931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.895010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.896305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.896305] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.896305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.896305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.896305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.896305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.896305] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba398af1-904a-41aa-b098-1f2b15a308ac',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.004554] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb in Status: SUCCESS [ 654.004554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.005115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.005115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.005115] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.005115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.005447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.005646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.005646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.005773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.005773] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59435e15-2dcf-4317-816e-1fcd9a40b9fb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.130265] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.131384] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.131592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.131866] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e42f6371-f854-4e39-ae20-c78d59217dbb with status ACTIVE [ 654.132040] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.132405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.132405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.132405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.132726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.133041] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.133041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.133041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.133560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.133700] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.133852] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.133963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.134199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.134199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.134857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.134857] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e42f6371-f854-4e39-ae20-c78d59217dbb is going to be updated. [ 654.162693] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.164635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.164635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.165447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.165447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.166685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e42f6371-f854-4e39-ae20-c78d59217dbb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.206598] env[62909]: INFO networking_nsxv3.common.synchronization [req-38254885-7d28-4d8a-95c8-e7aacbc71c1c req-55e58506-6cb0-4fc5-9a40-e5d3469188ff tempest-ServersTestFqdnHostnames-2028362432 tempest-ServersTestFqdnHostnames-2028362432-project-member] Enqueued Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_members [ 654.208804] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_members [ 654.208977] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-91426ce9-c57f-42ef-bcee-74c76f9876e0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.209111] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.209228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.209561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.209797] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.209977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.210098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.210283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.210372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.210471] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91426ce9-c57f-42ef-bcee-74c76f9876e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.399574] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.399574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.399574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.401485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.401485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.401485] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.401485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.401485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.401485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.401485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.401485] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba398af1-904a-41aa-b098-1f2b15a308ac is going to be updated. [ 654.484402] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.484402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.484402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.484402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.484402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.484402] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba398af1-904a-41aa-b098-1f2b15a308ac in Status: IN_PROGRESS for 2s [ 654.606468] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-59435e15-2dcf-4317-816e-1fcd9a40b9fb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.606468] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.606468] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-59435e15-2dcf-4317-816e-1fcd9a40b9fb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.606468] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.606468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.607376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.607376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.607376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.607376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.607376] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59435e15-2dcf-4317-816e-1fcd9a40b9fb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.633621] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.715273] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.715273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.715273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.715273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.715273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.715273] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.715273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.715273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.715273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.715273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.715273] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 already deleted. [ 654.715273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.015228] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59435e15-2dcf-4317-816e-1fcd9a40b9fb: rpc.has_security_group_logging(os_id): False [ 655.036502] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.036502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.036502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.036502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.036502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.036502] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.036782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.036807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.037758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.037758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.037758] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.037758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.037758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.037758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.037758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.037981] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.037981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.038742] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.039013] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.039235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.039326] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb is going to be created. [ 655.098868] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.099092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.099190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.099414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.099595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.113569] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb in Status: IN_PROGRESS for 2s [ 655.136611] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.136745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.137204] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.137204] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.137293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.137394] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d09a74b6-7c94-44f4-afba-b179607452eb is going to be created. [ 655.170063] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.170217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.170217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.170393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.170588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.183870] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: UNINITIALIZED for 2s [ 655.507601] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: SUCCESS [ 655.507601] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 deletion is rescheduled due to dependency. [ 655.507601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.627301] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-345 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.627446] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-345" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.627486] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-345" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.627886] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-345" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.628078] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.629081] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.629081] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.629081] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.629081] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.629081] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.631957] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.632180] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.632305] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.632471] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.632538] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.632666] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.677743] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.677986] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.678163] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.678703] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-345" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.678828] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.679085] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.679222] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.679610] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.679833] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.132828] env[62909]: INFO networking_nsxv3.common.synchronization [req-793300a6-bead-43e8-b1d6-0d2da6b00639 req-d4d187da-2a90-4c63-bce4-f0979943d326 tempest-ImagesTestJSON-652168268 tempest-ImagesTestJSON-652168268-project-member] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 656.133408] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 656.133697] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.133852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.133892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.137362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.137642] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.137775] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.137868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.138183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.138321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.138321] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.185182] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.186745] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.186745] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.186745] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.186745] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.186745] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc not found, creating... [ 656.187662] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.188430] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.188430] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.188550] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.188822] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.189339] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.190575] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.190575] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.190575] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.190575] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.190575] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc is going to be created. [ 656.225868] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.225868] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.225868] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.225868] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.225868] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.225868] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.479021] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba398af1-904a-41aa-b098-1f2b15a308ac in Status: SUCCESS [ 656.480418] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba398af1-904a-41aa-b098-1f2b15a308ac deletion is rescheduled due to dependency. [ 656.480418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba398af1-904a-41aa-b098-1f2b15a308ac" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.644366] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.644366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.644366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.644366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.644366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.644366] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.644366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.644366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.644366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.644366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.644366] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 656.646796] env[62909]: INFO networking_nsxv3.common.synchronization [req-90e7c0f8-3469-4376-8478-70ffce127eff req-cfe9cdd4-bdbb-4c0b-8550-4fc7b82630ce tempest-ServersTestMultiNic-523841259 tempest-ServersTestMultiNic-523841259-project-member] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 656.647986] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 656.649292] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.649556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.651187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.653706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.653706] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.653706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.653706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.653706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.653706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.653706] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.682029] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.682029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.682029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.682029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.682029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.691858] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 657.132577] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb in Status: SUCCESS [ 657.133848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.158553] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.194948] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: SUCCESS [ 657.195184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.196347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.196347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.196347] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.196637] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.196637] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.196851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.197233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.197233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.197233] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.511801] env[62909]: INFO networking_nsxv3.common.synchronization [None req-cf0d3384-cb51-4550-ae5b-e740c584e321 None None] Enqueued Resource ID: 1211c40a-db6d-4bfe-8684-d7f5c73fb141 with Priority: HIGHEST for action port [ 657.512336] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1211c40a-db6d-4bfe-8684-d7f5c73fb141 with Priority: HIGHEST for action port [ 657.514255] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-1211c40a-db6d-4bfe-8684-d7f5c73fb141 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.514484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1211c40a-db6d-4bfe-8684-d7f5c73fb141" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.514484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1211c40a-db6d-4bfe-8684-d7f5c73fb141" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.514758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1211c40a-db6d-4bfe-8684-d7f5c73fb141" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.514860] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1211c40a-db6d-4bfe-8684-d7f5c73fb141',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.664912] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.668026] env[62909]: INFO networking_nsxv3.common.synchronization [req-90e7c0f8-3469-4376-8478-70ffce127eff req-6f0c89b8-5833-4edc-94a5-3e056cc604ed tempest-ServersTestMultiNic-523841259 tempest-ServersTestMultiNic-523841259-project-member] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 657.668026] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 657.668026] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.668026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.702881] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.703108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.703198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.703456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.703673] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.703799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.703863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.704052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.704143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.704243] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.704380] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.704468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.704524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.704673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.704822] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.704911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.704966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.705110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.705179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.705255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.705338] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.860028] env[62909]: INFO networking_nsxv3.common.synchronization [None req-0cf95175-9f01-4362-9960-27e08f661370 None None] Enqueued Resource ID: 418f404d-0002-4409-9958-2665a664931a with Priority: HIGHEST for action port [ 657.860926] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 418f404d-0002-4409-9958-2665a664931a with Priority: HIGHEST for action port [ 657.861288] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-418f404d-0002-4409-9958-2665a664931a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.861430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-418f404d-0002-4409-9958-2665a664931a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.861482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-418f404d-0002-4409-9958-2665a664931a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.861953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-418f404d-0002-4409-9958-2665a664931a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.861953] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('418f404d-0002-4409-9958-2665a664931a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.016399] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1211c40a-db6d-4bfe-8684-d7f5c73fb141 [ 658.017603] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.017793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.017868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.018105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.018196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.018292] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1211c40a-db6d-4bfe-8684-d7f5c73fb141 already deleted. [ 658.018372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1211c40a-db6d-4bfe-8684-d7f5c73fb141" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.168837] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.168837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.168837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.168837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.168837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.168837] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 658.197844] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.198106] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.198521] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.199784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.199784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.211576] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 658.343485] env[62909]: INFO networking_nsxv3.common.synchronization [req-38254885-7d28-4d8a-95c8-e7aacbc71c1c req-ba7175a4-2088-4542-a069-6336d24bed83 service nova] Enqueued Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_rules [ 658.343666] env[62909]: INFO networking_nsxv3.common.synchronization [req-38254885-7d28-4d8a-95c8-e7aacbc71c1c req-ba7175a4-2088-4542-a069-6336d24bed83 service nova] Enqueued Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_members [ 658.343800] env[62909]: INFO networking_nsxv3.common.synchronization [req-38254885-7d28-4d8a-95c8-e7aacbc71c1c req-ba7175a4-2088-4542-a069-6336d24bed83 service nova] Enqueued Resource ID: eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc with Priority: HIGHEST for action port [ 658.344050] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_rules [ 658.344178] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_members [ 658.344274] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc with Priority: HIGHEST for action port [ 658.344821] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91426ce9-c57f-42ef-bcee-74c76f9876e0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.344947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.347121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.347395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.347488] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91426ce9-c57f-42ef-bcee-74c76f9876e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.348397] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-91426ce9-c57f-42ef-bcee-74c76f9876e0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.348519] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.348582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.348749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.348914] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.349026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.349105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.349219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.349297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.349387] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91426ce9-c57f-42ef-bcee-74c76f9876e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.353933] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.354085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.354175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.354320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.354396] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.359154] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d09a74b6-7c94-44f4-afba-b179607452eb: rpc.has_security_group_logging(os_id): False [ 658.367025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 418f404d-0002-4409-9958-2665a664931a [ 658.367025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.367025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.367025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.367025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.367025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.367025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:418f404d-0002-4409-9958-2665a664931a already deleted. [ 658.367025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-418f404d-0002-4409-9958-2665a664931a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.381986] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.382207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.382207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.384530] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.384530] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.384530] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.384530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.385370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.385370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.385370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.385370] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d09a74b6-7c94-44f4-afba-b179607452eb is going to be created. [ 658.457051] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.457051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.457051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.457734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.457734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.474221] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: IN_PROGRESS for 2s [ 658.476472] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-996e6836-9e26-438e-a375-68b6ee42b074 tempest-ListServersNegativeTestJSON-838840043 tempest-ListServersNegativeTestJSON-838840043-project-member] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 658.478373] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 658.481710] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.481710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.481710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.481710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.481710] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.481710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.481710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.481951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.481951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.481998] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.629588] env[62909]: INFO networking_nsxv3.common.synchronization [req-90e7c0f8-3469-4376-8478-70ffce127eff req-edbd3b5c-88c4-435b-86b7-41eb0bd8c72f tempest-ServersTestMultiNic-523841259 tempest-ServersTestMultiNic-523841259-project-member] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 658.630922] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 658.630922] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.630922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.704368] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 658.705507] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa deletion is rescheduled due to dependency. [ 658.705507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.856849] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-91426ce9-c57f-42ef-bcee-74c76f9876e0 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.856979] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.857111] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91426ce9-c57f-42ef-bcee-74c76f9876e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.865159] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc with status ACTIVE [ 658.865159] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.865159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.865159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.865159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.865159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.865377] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.865377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.865377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.866067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.866067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.866067] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.866067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.866067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.866067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.866302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.866302] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc is going to be updated. [ 658.893820] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.893820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.893820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.893820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.893820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.893820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eaf21f1d-ed3e-4cf6-ba5e-8213a6dd21bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.986097] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.986269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.986317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.986529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.986612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.986844] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.986944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.987015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.987166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.987239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.987323] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 already deleted. [ 658.987402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.278849] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.278849] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.278849] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.279366] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.279635] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.279805] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.280231] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.280359] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.280577] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.281142] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.281142] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.281142] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.281262] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.282126] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.282126] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.282126] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.316805] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.317043] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.317197] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.317362] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.317689] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-3a09d962-f1f2-4390-8d9e-9856c75ba69f taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.319135] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-3a09d962-f1f2-4390-8d9e-9856c75ba69f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.319135] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-3a09d962-f1f2-4390-8d9e-9856c75ba69f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.319135] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-3a09d962-f1f2-4390-8d9e-9856c75ba69f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.319135] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a09d962-f1f2-4390-8d9e-9856c75ba69f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.365778] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91426ce9-c57f-42ef-bcee-74c76f9876e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.823298] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.823298] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.823298] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.823747] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.823747] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.823747] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 3a09d962-f1f2-4390-8d9e-9856c75ba69f not found, creating... [ 659.823920] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.824092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.824197] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.824423] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.824555] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.824837] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.824994] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.825786] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.826337] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.826337] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.826337] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 3a09d962-f1f2-4390-8d9e-9856c75ba69f is going to be created. [ 659.854427] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.854427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.854427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.854427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.854427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.854427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-3a09d962-f1f2-4390-8d9e-9856c75ba69f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.868452] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.868638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.868692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.868941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.869093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.869162] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 is going to be created. [ 659.907298] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.907906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.907906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.907906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.908261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.928301] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 in Status: UNINITIALIZED for 2s [ 660.234037] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 4s [ 660.486778] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: SUCCESS [ 660.487053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.689619] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-0770e68d-b4c5-4c1f-bbf2-dec3525eda8d service nova] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_rules [ 660.690055] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-0770e68d-b4c5-4c1f-bbf2-dec3525eda8d service nova] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 660.695231] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-0770e68d-b4c5-4c1f-bbf2-dec3525eda8d service nova] Enqueued Resource ID: 3a09d962-f1f2-4390-8d9e-9856c75ba69f with Priority: HIGHEST for action port [ 660.695231] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_rules [ 660.695231] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 660.695231] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a09d962-f1f2-4390-8d9e-9856c75ba69f with Priority: HIGHEST for action port [ 660.695231] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.695231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.695231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.695231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.695231] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.696651] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.697035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.697203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.697494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.697738] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.697969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.698198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.698467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.698659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.699097] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.700116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a09d962-f1f2-4390-8d9e-9856c75ba69f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.700354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a09d962-f1f2-4390-8d9e-9856c75ba69f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.700704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a09d962-f1f2-4390-8d9e-9856c75ba69f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.703513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a09d962-f1f2-4390-8d9e-9856c75ba69f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.703513] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a09d962-f1f2-4390-8d9e-9856c75ba69f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.095755] env[62909]: INFO networking_nsxv3.common.synchronization [None req-5f42e5dc-9381-4b42-93f8-75fbea689cd9 None None] Enqueued Resource ID: 7c1479e9-c707-42d1-a65e-2677b8c87425 with Priority: HIGHEST for action port [ 661.096806] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c1479e9-c707-42d1-a65e-2677b8c87425 with Priority: HIGHEST for action port [ 661.096878] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c1479e9-c707-42d1-a65e-2677b8c87425 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.102228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c1479e9-c707-42d1-a65e-2677b8c87425" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.102228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c1479e9-c707-42d1-a65e-2677b8c87425" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.102228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c1479e9-c707-42d1-a65e-2677b8c87425" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.102228] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c1479e9-c707-42d1-a65e-2677b8c87425',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.204124] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.204374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.204662] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.206071] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a09d962-f1f2-4390-8d9e-9856c75ba69f with status ACTIVE [ 661.206319] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.206417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.206475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.206674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.206814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.208907] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.208907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.208907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.208907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.208907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.209400] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.209522] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.209666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.209895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.209992] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.210101] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a09d962-f1f2-4390-8d9e-9856c75ba69f is going to be updated. [ 661.236258] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.236408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.236473] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.236779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.236922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.237103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a09d962-f1f2-4390-8d9e-9856c75ba69f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.609516] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c1479e9-c707-42d1-a65e-2677b8c87425 [ 661.609877] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.609877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.610037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.611215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.611215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.611215] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c1479e9-c707-42d1-a65e-2677b8c87425 already deleted. [ 661.611215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c1479e9-c707-42d1-a65e-2677b8c87425" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.691316] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-439fd30e-4d6e-4fc8-9dca-ea1257898242 tempest-ListServersNegativeTestJSON-838840043 tempest-ListServersNegativeTestJSON-838840043-project-member] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 661.691316] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 661.691316] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.691316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.714545] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.940211] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 in Status: SUCCESS [ 661.940211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.940211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.940211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.940211] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.940211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.940211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.941315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.941315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.941315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.941315] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('91426ce9-c57f-42ef-bcee-74c76f9876e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.142566] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e515f24d-f519-4935-8c3d-f0d6e47328fb None None] Enqueued Resource ID: 10ec992c-3907-456d-a08a-744e4b2ac220 with Priority: HIGHEST for action port [ 662.143135] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ec992c-3907-456d-a08a-744e4b2ac220 with Priority: HIGHEST for action port [ 662.143443] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-10ec992c-3907-456d-a08a-744e4b2ac220 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.143561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10ec992c-3907-456d-a08a-744e4b2ac220" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.143624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10ec992c-3907-456d-a08a-744e4b2ac220" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.143872] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10ec992c-3907-456d-a08a-744e4b2ac220" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.143951] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ec992c-3907-456d-a08a-744e4b2ac220',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.217176] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.217176] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.217512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.217512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.217512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.217690] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be created. [ 662.241089] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 662.241263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.241472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.241713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.241900] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.242077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.242118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.242290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.242368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.242577] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.246266] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.248476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.248476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.248476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.248476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.257128] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: UNINITIALIZED for 2s [ 662.444044] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('91426ce9-c57f-42ef-bcee-74c76f9876e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.647292] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10ec992c-3907-456d-a08a-744e4b2ac220 [ 662.647614] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.647779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.647888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.648156] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.648432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.648632] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10ec992c-3907-456d-a08a-744e4b2ac220 already deleted. [ 662.648743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10ec992c-3907-456d-a08a-744e4b2ac220" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.744705] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.744705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.744836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.745497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.745497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.745497] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.745497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.745497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.745817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.745817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.745817] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 662.765257] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.765797] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.765797] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.766145] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.766878] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.766976] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.767442] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.767538] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.767771] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.768092] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.768284] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.768469] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.768672] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.768882] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.769286] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.769286] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.787381] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.787532] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.787603] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.787834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.787982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.794612] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.794612] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 662.794612] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.794612] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.794612] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-770e30b2-2f05-4531-b9d0-6482b3d18b22 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.794612] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-770e30b2-2f05-4531-b9d0-6482b3d18b22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.794612] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-770e30b2-2f05-4531-b9d0-6482b3d18b22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.794612] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-770e30b2-2f05-4531-b9d0-6482b3d18b22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.794612] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('770e30b2-2f05-4531-b9d0-6482b3d18b22',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.801726] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 662.947534] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 91426ce9-c57f-42ef-bcee-74c76f9876e0: rpc.has_security_group_logging(os_id): False [ 662.968597] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.968729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.968729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.969314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.969314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.969519] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.969612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.969718] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.970194] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.970676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.970946] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 is going to be created. [ 663.047971] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.048204] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.048274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.048479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.048713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.063437] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 in Status: IN_PROGRESS for 2s [ 663.296806] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.297095] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.297237] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.297702] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.297918] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.298265] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 770e30b2-2f05-4531-b9d0-6482b3d18b22 not found, creating... [ 663.298592] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.299029] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.299220] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.301793] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.301793] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.301793] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.301793] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.301793] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.301793] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.301793] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.302195] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 770e30b2-2f05-4531-b9d0-6482b3d18b22 is going to be created. [ 663.336061] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.336061] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.336061] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.336267] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.336530] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.336685] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-770e30b2-2f05-4531-b9d0-6482b3d18b22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.092799] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-90ec85e2-a679-4524-a8ca-ff7bf4a3b0f4 tempest-ListServersNegativeTestJSON-838840043 tempest-ListServersNegativeTestJSON-838840043-project-member] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 664.092799] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 664.092799] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.092799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.269195] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 664.269662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.269798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.270118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.270370] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.270583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.270684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.270891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.271031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.271187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.271653] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.273961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.273961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.274036] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.274216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.274216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.274370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.274462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.274565] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.746617] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-bdd4dcc5-881f-4bb7-9c37-573477d60a1e service nova] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_rules [ 664.746862] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-bdd4dcc5-881f-4bb7-9c37-573477d60a1e service nova] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 664.747063] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-bdd4dcc5-881f-4bb7-9c37-573477d60a1e service nova] Enqueued Resource ID: 770e30b2-2f05-4531-b9d0-6482b3d18b22 with Priority: HIGHEST for action port [ 664.749314] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_rules [ 664.749314] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 664.749314] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 770e30b2-2f05-4531-b9d0-6482b3d18b22 with Priority: HIGHEST for action port [ 664.749756] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.749858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.750075] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.750164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.750343] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-770e30b2-2f05-4531-b9d0-6482b3d18b22 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.750446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-770e30b2-2f05-4531-b9d0-6482b3d18b22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.750504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-770e30b2-2f05-4531-b9d0-6482b3d18b22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.750706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-770e30b2-2f05-4531-b9d0-6482b3d18b22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.750823] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('770e30b2-2f05-4531-b9d0-6482b3d18b22',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.776636] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.776763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.776999] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.818126] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 664.818412] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 deletion is rescheduled due to dependency. [ 664.818567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.819890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.820155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.820338] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.820477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.820543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.820690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.820795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.820947] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.868138] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.868325] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.868484] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.868874] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.869629] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.869811] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.869932] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.870983] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.870983] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.870983] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.870983] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.870983] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.870983] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.870983] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.871264] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.871264] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.899111] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.899111] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 664.899111] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.899111] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-145" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.899111] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-d1bc2a9f-2310-438f-a8f0-d1e1f60ef641 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.899111] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-d1bc2a9f-2310-438f-a8f0-d1e1f60ef641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.899111] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-d1bc2a9f-2310-438f-a8f0-d1e1f60ef641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.899111] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-d1bc2a9f-2310-438f-a8f0-d1e1f60ef641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.899111] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1bc2a9f-2310-438f-a8f0-d1e1f60ef641',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.081287] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 in Status: SUCCESS [ 665.081287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.206595] env[62909]: INFO networking_nsxv3.common.synchronization [req-4fdbb051-ba3d-4461-9ffe-51195e51314d req-a00c00ca-02d4-40fa-b22a-7663a5eb1b41 tempest-DeleteServersAdminTestJSON-1896056451 tempest-DeleteServersAdminTestJSON-1896056451-project-member] Enqueued Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 665.207546] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 with Priority: HIGHEST for action security_group_members [ 665.207812] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-11f84bbc-cc8c-4244-87ea-1493e7543f81 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.207975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.208028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.209051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.209346] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.209574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.209715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.210001] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.210395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.210602] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11f84bbc-cc8c-4244-87ea-1493e7543f81',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.253619] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 770e30b2-2f05-4531-b9d0-6482b3d18b22 with status ACTIVE [ 665.253765] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.253971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.253971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.254234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.254868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.254868] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.254868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.254868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.254868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.254868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.255098] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.255212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.255248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.255386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.255454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.255538] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 770e30b2-2f05-4531-b9d0-6482b3d18b22 is going to be updated. [ 665.280622] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.281246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.281442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.282026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.283421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.283421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-770e30b2-2f05-4531-b9d0-6482b3d18b22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.283421] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.324706] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.324870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.324870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.325160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.325160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.325716] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.325716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.325716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.325889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.325930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.326014] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 665.391330] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.391552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.391552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.393174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.393174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.401904] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.405102] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.405102] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.405102] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.405102] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.405102] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port d1bc2a9f-2310-438f-a8f0-d1e1f60ef641 not found, creating... [ 665.405102] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.405102] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.405102] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.405102] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.405102] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.405427] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.405427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.405427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.405427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.405427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.405566] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: d1bc2a9f-2310-438f-a8f0-d1e1f60ef641 is going to be created. [ 665.407352] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 665.435692] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.435976] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.436098] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.436444] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.436690] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.436993] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-d1bc2a9f-2310-438f-a8f0-d1e1f60ef641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.715231] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.715403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.715582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.715717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.716198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.717094] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.717315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.717441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.717799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.717908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.718027] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 is going to be updated. [ 665.781804] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.782013] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.782126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.782453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.782667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.784906] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.785094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.785198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.785484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.785608] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.785747] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be updated. [ 665.795845] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: IN_PROGRESS for 2s [ 665.822323] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.822474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.822543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.822812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.823048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.836525] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: IN_PROGRESS for 2s [ 666.251745] env[62909]: INFO networking_nsxv3.common.synchronization [req-80e0be51-cb4d-430a-8fff-db17373a0b04 req-8cafd81c-191c-4e29-bba1-225248bd4a5f tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 666.252465] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 666.252796] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.252923] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.252977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.253731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.254049] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.254232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.254333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.254707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.254837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.255309] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.414905] env[62909]: INFO networking_nsxv3.common.synchronization [req-61b7b355-e01d-4404-9375-7b1b336af26a req-123bb36d-b4bf-476d-9852-112c527cf2ec tempest-AttachInterfacesV270Test-2074000085 tempest-AttachInterfacesV270Test-2074000085-project-member] Enqueued Resource ID: bef0125d-be94-4dc6-922c-269322ae2b97 with Priority: HIGHEST for action security_group_members [ 666.415710] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef0125d-be94-4dc6-922c-269322ae2b97 with Priority: HIGHEST for action security_group_members [ 666.416480] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef0125d-be94-4dc6-922c-269322ae2b97 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.416887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.417024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.417501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.417951] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.418186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.418344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.418630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.418867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.419087] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bef0125d-be94-4dc6-922c-269322ae2b97',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.757599] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.758078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.758192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.758500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.758634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.758947] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.760600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.760600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.760600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.760726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.760788] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 already deleted. [ 666.760893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.812364] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.812543] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-590" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.812658] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-590" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.812988] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-590" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.813255] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.813403] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.813512] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.813729] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.813998] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.814309] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.814444] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.814545] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.814668] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.814755] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.814856] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.814999] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.837075] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.837075] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 666.837075] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.837075] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-590" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.837075] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-ce7a44ed-a822-4d9c-ac68-4d421b3d5b23 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.837075] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-ce7a44ed-a822-4d9c-ac68-4d421b3d5b23" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.837075] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-ce7a44ed-a822-4d9c-ac68-4d421b3d5b23" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.837385] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-ce7a44ed-a822-4d9c-ac68-4d421b3d5b23" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.837385] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce7a44ed-a822-4d9c-ac68-4d421b3d5b23',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.902933] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-36a4efdf-4b4e-487f-a0b4-1db6f813284d service nova] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_rules [ 666.903159] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-36a4efdf-4b4e-487f-a0b4-1db6f813284d service nova] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 666.903398] env[62909]: INFO networking_nsxv3.common.synchronization [req-c32b41be-f73b-48f5-8112-89175ee4f0db req-36a4efdf-4b4e-487f-a0b4-1db6f813284d service nova] Enqueued Resource ID: d1bc2a9f-2310-438f-a8f0-d1e1f60ef641 with Priority: HIGHEST for action port [ 666.903531] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_rules [ 666.903657] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 666.903750] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1bc2a9f-2310-438f-a8f0-d1e1f60ef641 with Priority: HIGHEST for action port [ 666.904303] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.904410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.904605] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.904688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.904862] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1bc2a9f-2310-438f-a8f0-d1e1f60ef641 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.904961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1bc2a9f-2310-438f-a8f0-d1e1f60ef641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.906857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1bc2a9f-2310-438f-a8f0-d1e1f60ef641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.909060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1bc2a9f-2310-438f-a8f0-d1e1f60ef641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.909060] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1bc2a9f-2310-438f-a8f0-d1e1f60ef641',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.921801] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.923488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.923488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.923488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.923488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.923488] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.923488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.923488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.923488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.923488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.923488] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef0125d-be94-4dc6-922c-269322ae2b97 already deleted. [ 666.923488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.100853] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.101404] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.101404] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.101753] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.101887] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.104030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.104030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.104030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.104030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.104030] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.104030] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.104419] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.104419] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.104419] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.104506] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.104608] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.143700] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.143700] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 667.143700] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.143700] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.143700] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-ec98f693-b488-485c-8165-c736ecc6b3d7 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.143700] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-ec98f693-b488-485c-8165-c736ecc6b3d7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.143700] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-ec98f693-b488-485c-8165-c736ecc6b3d7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.143700] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-ec98f693-b488-485c-8165-c736ecc6b3d7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.143700] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec98f693-b488-485c-8165-c736ecc6b3d7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.342092] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.342092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.342092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.342092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.342092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.342092] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port ce7a44ed-a822-4d9c-ac68-4d421b3d5b23 not found, creating... [ 667.342092] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.342092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.342970] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.343484] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.343776] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.344591] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.344591] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.344732] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.345024] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.345825] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.345825] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: ce7a44ed-a822-4d9c-ac68-4d421b3d5b23 is going to be created. [ 667.369669] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.369905] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.370074] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.370338] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.370569] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.370796] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-ce7a44ed-a822-4d9c-ac68-4d421b3d5b23" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.411348] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1bc2a9f-2310-438f-a8f0-d1e1f60ef641 with status ACTIVE [ 667.411555] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.411690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.411758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.412710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.412710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.412710] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.412710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.412710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.412710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.412710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.412993] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.412993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.412993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.413098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.413125] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.413189] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1bc2a9f-2310-438f-a8f0-d1e1f60ef641 is going to be updated. [ 667.422585] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 667.422585] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 deletion is rescheduled due to dependency. [ 667.422884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.437227] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.437889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.438183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.438261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.438430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.438617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1bc2a9f-2310-438f-a8f0-d1e1f60ef641" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.648605] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.648907] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.649133] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.649389] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.649668] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.649728] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port ec98f693-b488-485c-8165-c736ecc6b3d7 not found, creating... [ 667.653023] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.653023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.653023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.653023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.653023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.653023] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.653023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.653023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.653578] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.653578] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.653578] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: ec98f693-b488-485c-8165-c736ecc6b3d7 is going to be created. [ 667.686080] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.686372] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.686442] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.686740] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.686999] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.687273] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-ec98f693-b488-485c-8165-c736ecc6b3d7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.776420] env[62909]: INFO networking_nsxv3.common.synchronization [None req-97902e71-a617-4aa7-822c-584a3509d96c None None] Enqueued Resource ID: 355e2309-9173-47bc-be15-677a945c9c18 with Priority: HIGHEST for action port [ 667.777147] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 355e2309-9173-47bc-be15-677a945c9c18 with Priority: HIGHEST for action port [ 667.777556] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-355e2309-9173-47bc-be15-677a945c9c18 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.777752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-355e2309-9173-47bc-be15-677a945c9c18" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.777752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-355e2309-9173-47bc-be15-677a945c9c18" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.783240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-355e2309-9173-47bc-be15-677a945c9c18" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.783240] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('355e2309-9173-47bc-be15-677a945c9c18',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.813689] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 in Status: SUCCESS [ 667.813689] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11f84bbc-cc8c-4244-87ea-1493e7543f81 deletion is rescheduled due to dependency. [ 667.813689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11f84bbc-cc8c-4244-87ea-1493e7543f81" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.849101] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 667.853188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.853188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.853188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.853188] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.853188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.853188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.853188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.853188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.853188] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.285130] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 355e2309-9173-47bc-be15-677a945c9c18 [ 668.286884] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.287591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.287726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.287983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.288158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.288221] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:355e2309-9173-47bc-be15-677a945c9c18 already deleted. [ 668.288341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-355e2309-9173-47bc-be15-677a945c9c18" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.322132] env[62909]: INFO networking_nsxv3.common.synchronization [req-61b7b355-e01d-4404-9375-7b1b336af26a req-961f56d6-c938-4435-ac1a-529fd13ea52b service nova] Enqueued Resource ID: bef0125d-be94-4dc6-922c-269322ae2b97 with Priority: HIGHEST for action security_group_rules [ 668.322462] env[62909]: INFO networking_nsxv3.common.synchronization [req-61b7b355-e01d-4404-9375-7b1b336af26a req-961f56d6-c938-4435-ac1a-529fd13ea52b service nova] Enqueued Resource ID: bef0125d-be94-4dc6-922c-269322ae2b97 with Priority: HIGHEST for action security_group_members [ 668.322649] env[62909]: INFO networking_nsxv3.common.synchronization [req-61b7b355-e01d-4404-9375-7b1b336af26a req-961f56d6-c938-4435-ac1a-529fd13ea52b service nova] Enqueued Resource ID: ce7a44ed-a822-4d9c-ac68-4d421b3d5b23 with Priority: HIGHEST for action port [ 668.323315] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef0125d-be94-4dc6-922c-269322ae2b97 with Priority: HIGHEST for action security_group_rules [ 668.324471] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef0125d-be94-4dc6-922c-269322ae2b97 with Priority: HIGHEST for action security_group_members [ 668.324631] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce7a44ed-a822-4d9c-ac68-4d421b3d5b23 with Priority: HIGHEST for action port [ 668.326152] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bef0125d-be94-4dc6-922c-269322ae2b97 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.326771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.326865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.327158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.327886] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bef0125d-be94-4dc6-922c-269322ae2b97',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.329578] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef0125d-be94-4dc6-922c-269322ae2b97 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.333638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.333724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.333946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.334690] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.334886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.335020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.335420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.335520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.335687] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bef0125d-be94-4dc6-922c-269322ae2b97',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.337171] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce7a44ed-a822-4d9c-ac68-4d421b3d5b23 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.337366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce7a44ed-a822-4d9c-ac68-4d421b3d5b23" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.337469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce7a44ed-a822-4d9c-ac68-4d421b3d5b23" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.337706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce7a44ed-a822-4d9c-ac68-4d421b3d5b23" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.337812] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce7a44ed-a822-4d9c-ac68-4d421b3d5b23',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.357248] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.635300] env[62909]: INFO networking_nsxv3.common.synchronization [req-156484d4-7265-461e-afa9-8cbb5d19568b req-8a92e792-b32c-488b-89d2-0f86bcfcc6d4 tempest-ImagesOneServerTestJSON-1204860044 tempest-ImagesOneServerTestJSON-1204860044-project-member] Enqueued Resource ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc with Priority: HIGHEST for action security_group_members [ 668.636087] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc with Priority: HIGHEST for action security_group_members [ 668.640659] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e434cf-a3e8-49df-8050-fa1d2489f7dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.640891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.640973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.641201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.641796] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.642771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.642771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.642771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.642771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.642771] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73e434cf-a3e8-49df-8050-fa1d2489f7dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.841122] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bef0125d-be94-4dc6-922c-269322ae2b97',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.842979] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef0125d-be94-4dc6-922c-269322ae2b97 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.843756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.843756] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce7a44ed-a822-4d9c-ac68-4d421b3d5b23 with status ACTIVE [ 668.843756] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.843756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.843756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.844123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.844123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.844123] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.844218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.844218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.844853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.844853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.844853] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.844853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.844853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.844853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.845156] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.845156] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce7a44ed-a822-4d9c-ac68-4d421b3d5b23 is going to be updated. [ 668.860682] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.868284] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.868485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.868600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.868843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.869025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.869227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce7a44ed-a822-4d9c-ac68-4d421b3d5b23" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.033706] env[62909]: INFO networking_nsxv3.common.synchronization [req-80e0be51-cb4d-430a-8fff-db17373a0b04 req-12f71eda-f0e5-4179-b379-385b450b6e65 service nova] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_rules [ 669.033938] env[62909]: INFO networking_nsxv3.common.synchronization [req-80e0be51-cb4d-430a-8fff-db17373a0b04 req-12f71eda-f0e5-4179-b379-385b450b6e65 service nova] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 669.034117] env[62909]: INFO networking_nsxv3.common.synchronization [req-80e0be51-cb4d-430a-8fff-db17373a0b04 req-12f71eda-f0e5-4179-b379-385b450b6e65 service nova] Enqueued Resource ID: ec98f693-b488-485c-8165-c736ecc6b3d7 with Priority: HIGHEST for action port [ 669.034695] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_rules [ 669.034847] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 669.035012] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec98f693-b488-485c-8165-c736ecc6b3d7 with Priority: HIGHEST for action port [ 669.039644] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.039644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.039644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.039644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.039644] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.039644] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.039644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.039644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.039644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.039644] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.039644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.039644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.039644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.039644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.039644] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.040951] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec98f693-b488-485c-8165-c736ecc6b3d7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.041270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec98f693-b488-485c-8165-c736ecc6b3d7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.041477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec98f693-b488-485c-8165-c736ecc6b3d7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.041765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec98f693-b488-485c-8165-c736ecc6b3d7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.041967] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec98f693-b488-485c-8165-c736ecc6b3d7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.199157] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.199157] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.199157] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc is going to be updated. [ 669.199157] env[62909]: INFO networking_nsxv3.common.synchronization [req-18a4963e-d977-42d5-bb3f-d6a7ea966b32 req-020d6c42-2687-41dc-acd9-1bb6dcebbe44 tempest-ServerAddressesNegativeTestJSON-977920271 tempest-ServerAddressesNegativeTestJSON-977920271-project-member] Enqueued Resource ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 with Priority: HIGHEST for action security_group_members [ 669.199157] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 with Priority: HIGHEST for action security_group_members [ 669.199157] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3153bb13-485b-4639-83ed-2a27b9bcedf0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.199157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.201819] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.201819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.201819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.201819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.201819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.201819] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3153bb13-485b-4639-83ed-2a27b9bcedf0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.201819] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.201819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.201819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.201819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.201819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.212121] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc in Status: IN_PROGRESS for 2s [ 669.350191] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bef0125d-be94-4dc6-922c-269322ae2b97',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.363211] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.363211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.363211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.363211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.363724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.363724] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be updated. [ 669.402053] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.402233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.402333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.402594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.402757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.416960] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: IN_PROGRESS for 2s [ 669.538255] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.538255] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-484" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.538255] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-484" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.538255] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-484" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.538255] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.538255] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.538255] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.538255] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.538255] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.538255] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.538255] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.538255] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.538255] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.538821] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.538821] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.538821] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.544502] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.545657] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.545847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.545917] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec98f693-b488-485c-8165-c736ecc6b3d7 with status ACTIVE [ 669.546105] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.546213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.546281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.546494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.546574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.546751] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.546872] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.546939] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.547114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.547192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.547375] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.547468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.547529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.547666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.547741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.547823] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec98f693-b488-485c-8165-c736ecc6b3d7 is going to be updated. [ 669.563133] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.563133] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 669.563331] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.563363] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-484" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.563664] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-5c562670-f8c1-48c4-9630-586f87930b56 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.563840] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-5c562670-f8c1-48c4-9630-586f87930b56" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.563960] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-5c562670-f8c1-48c4-9630-586f87930b56" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.564974] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-5c562670-f8c1-48c4-9630-586f87930b56" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.565185] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c562670-f8c1-48c4-9630-586f87930b56',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.573183] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.573321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.574127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.574127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.574127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.574127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec98f693-b488-485c-8165-c736ecc6b3d7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.664712] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.667177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.667177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.667177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.667177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.667177] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.667177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.667177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.667177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.667177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.667177] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 already deleted. [ 669.667177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.851887] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.852068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.852144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.852355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.852445] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.852541] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef0125d-be94-4dc6-922c-269322ae2b97 is going to be created. [ 669.878360] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.878497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.878567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.878810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.878969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.890594] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef0125d-be94-4dc6-922c-269322ae2b97 in Status: UNINITIALIZED for 2s [ 670.050273] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.067872] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.068207] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.068355] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.068634] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.068783] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.068974] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 5c562670-f8c1-48c4-9630-586f87930b56 not found, creating... [ 670.069267] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.069461] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.069870] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.069870] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.069995] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.070251] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.070410] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.070745] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.070745] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.070847] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.070985] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 5c562670-f8c1-48c4-9630-586f87930b56 is going to be created. [ 670.094746] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.094746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.094746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.094746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.094746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.094746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-5c562670-f8c1-48c4-9630-586f87930b56" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.385588] env[62909]: INFO networking_nsxv3.common.synchronization [None req-617ece07-7e1d-4faf-b9c2-a4bbe79ac88e None None] Enqueued Resource ID: da4b9f84-03a8-47e5-a610-4229db4f40f6 with Priority: HIGHEST for action port [ 670.386372] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4b9f84-03a8-47e5-a610-4229db4f40f6 with Priority: HIGHEST for action port [ 670.386793] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-da4b9f84-03a8-47e5-a610-4229db4f40f6 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.386999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da4b9f84-03a8-47e5-a610-4229db4f40f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.387190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da4b9f84-03a8-47e5-a610-4229db4f40f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.387605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da4b9f84-03a8-47e5-a610-4229db4f40f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.387605] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4b9f84-03a8-47e5-a610-4229db4f40f6',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.556631] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.557017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.557118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.557308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.557400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.557506] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be created. [ 670.618762] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.618762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.618762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.618762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.618762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.632585] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: UNINITIALIZED for 2s [ 670.807946] env[62909]: INFO networking_nsxv3.common.synchronization [None req-fdf48ea8-b7e3-48e9-831c-dbb451251a72 tempest-ServersTestJSON-1417391248 tempest-ServersTestJSON-1417391248-project-member] Enqueued Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_rules [ 670.807946] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_rules [ 670.807946] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2510be9a-503b-4668-a63b-e04e4a0997dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.807946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.807946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.810160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.810251] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.891178] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da4b9f84-03a8-47e5-a610-4229db4f40f6 [ 670.893502] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.893502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.893502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.893502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.893502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.893502] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da4b9f84-03a8-47e5-a610-4229db4f40f6 already deleted. [ 670.893502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da4b9f84-03a8-47e5-a610-4229db4f40f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.903832] env[62909]: INFO networking_nsxv3.common.synchronization [None req-2b7e08af-76b4-462f-8e2a-90fa0a67497b tempest-ServersTestJSON-1417391248 tempest-ServersTestJSON-1417391248-project-member] Enqueued Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_rules [ 670.903832] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_rules [ 670.903832] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2510be9a-503b-4668-a63b-e04e4a0997dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.903832] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.225977] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc in Status: SUCCESS [ 671.226211] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc deletion is rescheduled due to dependency. [ 671.226355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.337551] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.337767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.337878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.338128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.338227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.338357] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2510be9a-503b-4668-a63b-e04e4a0997dc already deleted. [ 671.338453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.338630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.338801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.338943] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.345974] env[62909]: INFO networking_nsxv3.common.synchronization [req-18a4963e-d977-42d5-bb3f-d6a7ea966b32 req-62b1800f-67fb-444b-be92-344ca0a74747 service nova] Enqueued Resource ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 with Priority: HIGHEST for action security_group_rules [ 671.346194] env[62909]: INFO networking_nsxv3.common.synchronization [req-18a4963e-d977-42d5-bb3f-d6a7ea966b32 req-62b1800f-67fb-444b-be92-344ca0a74747 service nova] Enqueued Resource ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 with Priority: HIGHEST for action security_group_members [ 671.346335] env[62909]: INFO networking_nsxv3.common.synchronization [req-18a4963e-d977-42d5-bb3f-d6a7ea966b32 req-62b1800f-67fb-444b-be92-344ca0a74747 service nova] Enqueued Resource ID: 5c562670-f8c1-48c4-9630-586f87930b56 with Priority: HIGHEST for action port [ 671.347035] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 with Priority: HIGHEST for action security_group_rules [ 671.347466] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 with Priority: HIGHEST for action security_group_members [ 671.347577] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c562670-f8c1-48c4-9630-586f87930b56 with Priority: HIGHEST for action port [ 671.350567] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3153bb13-485b-4639-83ed-2a27b9bcedf0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.350717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.350786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.351084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.351186] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3153bb13-485b-4639-83ed-2a27b9bcedf0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.352258] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3153bb13-485b-4639-83ed-2a27b9bcedf0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.352375] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.352456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.352632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.352809] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.352874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.352938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.353218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.353309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.353411] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3153bb13-485b-4639-83ed-2a27b9bcedf0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.354441] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c562670-f8c1-48c4-9630-586f87930b56 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.354545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c562670-f8c1-48c4-9630-586f87930b56" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.354636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c562670-f8c1-48c4-9630-586f87930b56" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.354748] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c562670-f8c1-48c4-9630-586f87930b56" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.355454] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c562670-f8c1-48c4-9630-586f87930b56',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.429422] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 671.429850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.431814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.431814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.431814] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.431814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.431814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.431814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.431814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.432158] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.857346] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3153bb13-485b-4639-83ed-2a27b9bcedf0 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.860022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.860022] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3153bb13-485b-4639-83ed-2a27b9bcedf0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.860022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c562670-f8c1-48c4-9630-586f87930b56 with status ACTIVE [ 671.860022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.860022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.860022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.860398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.860573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.860862] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.861109] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.861420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.861691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.861890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.862305] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.862536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.862749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.863017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.863201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.863386] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c562670-f8c1-48c4-9630-586f87930b56 is going to be updated. [ 671.865691] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.865937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.866102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.866377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.866599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.866802] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2510be9a-503b-4668-a63b-e04e4a0997dc already deleted. [ 671.866994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.900365] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.900443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.900443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.900692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.900844] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.901306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c562670-f8c1-48c4-9630-586f87930b56" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.903043] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef0125d-be94-4dc6-922c-269322ae2b97 in Status: SUCCESS [ 671.903263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.903442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.903561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.903737] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.903845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.903921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.904145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.904257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.904257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.904353] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bef0125d-be94-4dc6-922c-269322ae2b97',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.935435] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.368212] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3153bb13-485b-4639-83ed-2a27b9bcedf0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.407732] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef0125d-be94-4dc6-922c-269322ae2b97 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.407969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.408088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.408373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.408613] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.408885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.408885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.409212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.409280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.409380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.409602] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef0125d-be94-4dc6-922c-269322ae2b97 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.409780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.410069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.410255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.410418] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.410516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.410579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.410725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.410814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.410887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.411012] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bef0125d-be94-4dc6-922c-269322ae2b97',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.437322] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.652435] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 672.654414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.654785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.654878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.655394] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.655508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.655508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.655704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.655793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.655905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.656036] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.871120] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.871364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.871479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.871674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.871768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.871903] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 is going to be created. [ 672.907683] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.907834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.907901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.908206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.908376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.915874] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bef0125d-be94-4dc6-922c-269322ae2b97: rpc.has_security_group_logging(os_id): False [ 672.921419] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 in Status: UNINITIALIZED for 2s [ 672.940124] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.940501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.940601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.940819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.940911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.941030] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be updated. [ 672.943762] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.943954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.943954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.944211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.944281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.944467] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.944571] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.944630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.944812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.944853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.945074] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.945172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.945237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.945374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.945446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.945630] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.945720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.945770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.945930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.946072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.946291] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bef0125d-be94-4dc6-922c-269322ae2b97 is going to be created. [ 672.976135] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.976363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.976363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.976598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.976795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.990993] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: IN_PROGRESS for 2s [ 673.029733] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.029733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.030506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.030506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.030506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.048514] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bef0125d-be94-4dc6-922c-269322ae2b97 in Status: IN_PROGRESS for 2s [ 673.159036] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.159201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.159355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.160160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.160160] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.160160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.160160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.160160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.160328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.160328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.160451] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.160518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.160578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.160725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.160860] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.160971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.161068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.161192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.161330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.161564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.161564] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.663938] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e66bfb9-974f-43a6-93f8-54f17b7d81b3: rpc.has_security_group_logging(os_id): False [ 673.669943] env[62909]: INFO networking_nsxv3.common.synchronization [req-72e9c983-5bb9-47d4-8838-a21284ceeb4d req-dec814b1-7830-44b7-99a0-b8f26769b39b tempest-TenantUsagesTestJSON-824276567 tempest-TenantUsagesTestJSON-824276567-project-member] Enqueued Resource ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb with Priority: HIGHEST for action security_group_members [ 673.670694] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb with Priority: HIGHEST for action security_group_members [ 673.671136] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-59435e15-2dcf-4317-816e-1fcd9a40b9fb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.671336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.671336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.671629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.672356] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.672356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.672356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.672356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.672639] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.672639] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59435e15-2dcf-4317-816e-1fcd9a40b9fb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.714018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.714018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.714018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.714331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.714331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.715062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.715062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.715062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.715338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.715468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.715926] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.716102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.716192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.716411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.716523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.716846] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.716977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.717027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.717238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.717352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.717468] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be created. [ 673.812360] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.812360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.812360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.812360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.812360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.830255] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 674.179538] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.179708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.179781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.180026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.180139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.180356] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.180457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.180523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.180672] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.180745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.180829] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb is going to be updated. [ 674.217760] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.217937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.217973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.218308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.218457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.228387] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb in Status: IN_PROGRESS for 2s [ 674.933595] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 in Status: SUCCESS [ 674.933941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.934077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.934436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.934554] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.934708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.934766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.935857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.936248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.936248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.936412] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3153bb13-485b-4639-83ed-2a27b9bcedf0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.005108] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 675.005622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.005888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.006071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.006352] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.006482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.006574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.006812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.006931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.007108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.007360] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.007478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.007547] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.007703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.008756] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.008885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.009039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.009277] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.009403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.009534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.009677] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.010749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.010918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.015334] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.015503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.015593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.015999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.015999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.016099] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.063966] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bef0125d-be94-4dc6-922c-269322ae2b97 in Status: SUCCESS [ 675.064371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.188975] env[62909]: INFO networking_nsxv3.common.synchronization [req-b6c33eb6-c4da-420f-8098-fc7432db7d67 req-00f9b091-8b5d-4a08-8e46-510491e969c1 tempest-ServersTestBootFromVolume-1983048922 tempest-ServersTestBootFromVolume-1983048922-project-member] Enqueued Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_members [ 675.189683] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9854b6b4-9fde-4807-83f9-b2838c42920a with Priority: HIGHEST for action security_group_members [ 675.192700] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-9854b6b4-9fde-4807-83f9-b2838c42920a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.192853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.192931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.193158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.193346] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.194576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.194644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.194814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.194903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.195015] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9854b6b4-9fde-4807-83f9-b2838c42920a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.338660] env[62909]: INFO networking_nsxv3.common.synchronization [req-aeeb57b1-c6b7-487f-843a-eaa28fb14284 req-79c05b4d-d3a4-429a-ab81-4981aab905dc tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 675.339488] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 675.340405] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.341063] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.341287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.341777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.342045] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.342264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.342415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.342664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.342851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.343058] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.442067] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3153bb13-485b-4639-83ed-2a27b9bcedf0 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.442067] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.442067] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3153bb13-485b-4639-83ed-2a27b9bcedf0 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.442067] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.442067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.442714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.442714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.442714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.442714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.443259] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3153bb13-485b-4639-83ed-2a27b9bcedf0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.518352] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 037af277-a74d-482c-b3ec-c4b5f5f92980: rpc.has_security_group_logging(os_id): False [ 675.520177] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.542565] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.542773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.542853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.543206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.543422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.543625] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.543761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.545941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.546856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.546856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.546856] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.547174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.547174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.547292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.548296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.548296] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.548296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.548296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.548296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.548296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.548736] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be created. [ 675.678253] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.678253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.678253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.678253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.678253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.698809] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.698809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.698809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.699323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.699392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.699689] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.699834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.699942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.700206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.700346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.700427] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9854b6b4-9fde-4807-83f9-b2838c42920a is going to be updated. [ 675.747980] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: IN_PROGRESS for 2s [ 675.845912] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.846161] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.846341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.846548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.846680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.847263] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.847339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.847461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.847640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.847731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.847833] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 675.865605] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.865605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.865902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.866000] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.866243] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.868530] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 675.868706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.884078] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9854b6b4-9fde-4807-83f9-b2838c42920a in Status: IN_PROGRESS for 2s [ 675.940875] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.941336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.941336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.941536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.941536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.945741] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3153bb13-485b-4639-83ed-2a27b9bcedf0: rpc.has_security_group_logging(os_id): False [ 675.963123] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 675.970329] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.970612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.970702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.971179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.971356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.971756] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.971900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.971966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.972297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.972437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.972785] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.972977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.973113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.973367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.973541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.973960] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.974149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.974262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.975573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.975573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.975573] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 is going to be created. [ 676.024145] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.091933] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.092182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 676.092240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.098117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 676.098117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 676.109344] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 in Status: IN_PROGRESS for 2s [ 676.242725] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb in Status: SUCCESS [ 676.242725] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb deletion is rescheduled due to dependency. [ 676.242725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 676.526890] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.527216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 676.527311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.527612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 676.527732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 676.527859] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be updated. [ 676.566994] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.567211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 676.567636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.568479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 676.568738] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 676.581436] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: IN_PROGRESS for 2s [ 676.998842] env[62909]: INFO networking_nsxv3.common.synchronization [req-da64fea4-ba65-4dc4-848e-cf2394bc5a02 req-6c36d6ed-322d-45b5-a94e-dc79bf3259fa tempest-ServersAdminNegativeTestJSON-1035945787 tempest-ServersAdminNegativeTestJSON-1035945787-project-member] Enqueued Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 676.999474] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 676.999775] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.999884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 677.000134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.001045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 677.001164] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.001265] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 677.001380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.001505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 677.001588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 677.001684] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.506077] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.764138] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 677.764291] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 677.764480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.764924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 677.764924] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.895281] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9854b6b4-9fde-4807-83f9-b2838c42920a in Status: SUCCESS [ 677.895463] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9854b6b4-9fde-4807-83f9-b2838c42920a deletion is rescheduled due to dependency. [ 677.895613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9854b6b4-9fde-4807-83f9-b2838c42920a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 677.929742] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ae24ee99-e658-413b-8bd8-b9a2536c84b2 tempest-MigrationsAdminTest-16747298 tempest-MigrationsAdminTest-16747298-project-member] Enqueued Resource ID: df9cd38b-47f3-46eb-8ae2-8c02752312a8 with Priority: HIGHEST for action security_group_rules [ 677.931646] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9cd38b-47f3-46eb-8ae2-8c02752312a8 with Priority: HIGHEST for action security_group_rules [ 677.931971] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9cd38b-47f3-46eb-8ae2-8c02752312a8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.932113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9cd38b-47f3-46eb-8ae2-8c02752312a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 677.932181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9cd38b-47f3-46eb-8ae2-8c02752312a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.932434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9cd38b-47f3-46eb-8ae2-8c02752312a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 677.932519] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9cd38b-47f3-46eb-8ae2-8c02752312a8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.981098] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 677.981238] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f deletion is rescheduled due to dependency. [ 677.981360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 678.015595] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.044834] env[62909]: INFO networking_nsxv3.common.synchronization [None req-18b62514-9877-4fdd-9650-1827d82bfab2 tempest-MigrationsAdminTest-16747298 tempest-MigrationsAdminTest-16747298-project-member] Enqueued Resource ID: df9cd38b-47f3-46eb-8ae2-8c02752312a8 with Priority: HIGHEST for action security_group_rules [ 678.045269] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9cd38b-47f3-46eb-8ae2-8c02752312a8 with Priority: HIGHEST for action security_group_rules [ 678.045578] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9cd38b-47f3-46eb-8ae2-8c02752312a8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.045685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9cd38b-47f3-46eb-8ae2-8c02752312a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 678.127633] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 in Status: SUCCESS [ 678.127864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 678.273644] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.273644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 678.459307] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.459606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 678.459606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.459848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 678.460035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 678.460125] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9cd38b-47f3-46eb-8ae2-8c02752312a8 already deleted. [ 678.460253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9cd38b-47f3-46eb-8ae2-8c02752312a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 678.460455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9cd38b-47f3-46eb-8ae2-8c02752312a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.460669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9cd38b-47f3-46eb-8ae2-8c02752312a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 678.461034] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9cd38b-47f3-46eb-8ae2-8c02752312a8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.518136] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.518136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 678.518373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.518806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 678.518806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 678.518806] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d635d2b-1797-4206-b032-b7450c1074bc is going to be updated. [ 678.559767] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.559981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 678.560061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.560363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 678.560560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 678.572809] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: IN_PROGRESS for 2s [ 678.591834] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 678.592640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 678.592640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.592640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 678.592640] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.592640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 678.592875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.592987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 678.593371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 678.593371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 678.593371] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.002759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.004193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.004193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.004407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.004407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.004508] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9cd38b-47f3-46eb-8ae2-8c02752312a8 already deleted. [ 679.005083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9cd38b-47f3-46eb-8ae2-8c02752312a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.098875] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.098875] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.098875] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.098875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.098875] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.100483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.100597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.100755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.100840] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.100999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.101061] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.603652] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 037af277-a74d-482c-b3ec-c4b5f5f92980: rpc.has_security_group_logging(os_id): False [ 679.627663] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.627867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.628628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.629440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.630308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.630308] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.631663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.631734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.631926] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.632024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.632245] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.632338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.632396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.632541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.632609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.633064] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.633064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.633064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.633064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.633279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.633279] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be updated. [ 679.700607] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.700944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.700944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.701209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.701258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.716373] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: IN_PROGRESS for 2s [ 679.820197] env[62909]: INFO networking_nsxv3.common.synchronization [req-db035b21-cfc1-4352-ae0a-8a04681b0c74 req-bc5a97d8-9b54-47ff-bec0-f7492d179671 tempest-ListServersNegativeTestJSON-838840043 tempest-ListServersNegativeTestJSON-838840043-project-member] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 679.820197] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 679.820448] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.820613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.820693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.820970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.821093] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.821427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.821427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.821427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.821534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.821602] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.325935] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.585101] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: SUCCESS [ 680.585101] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.829110] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.830809] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b25ffdad-a2f1-4507-93ca-a9f9d8956e30 None None] Enqueued Resource ID: a0c68114-01db-4586-aaf1-a9d773708544 with Priority: HIGHEST for action port [ 680.831317] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0c68114-01db-4586-aaf1-a9d773708544 with Priority: HIGHEST for action port [ 680.831900] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0c68114-01db-4586-aaf1-a9d773708544 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.831980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0c68114-01db-4586-aaf1-a9d773708544" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.832062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0c68114-01db-4586-aaf1-a9d773708544" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.832318] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0c68114-01db-4586-aaf1-a9d773708544" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.832394] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0c68114-01db-4586-aaf1-a9d773708544',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.332207] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.332560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.332560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.332629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.332696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 681.332794] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be updated. [ 681.334418] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0c68114-01db-4586-aaf1-a9d773708544 [ 681.334591] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.334699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.334764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.334937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.335516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 681.335665] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0c68114-01db-4586-aaf1-a9d773708544 already deleted. [ 681.335765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0c68114-01db-4586-aaf1-a9d773708544" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 681.376860] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.377065] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.377143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.377929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.377929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 681.388481] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: IN_PROGRESS for 2s [ 681.737879] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 681.738245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 681.738451] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.738715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.738841] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.228206] env[62909]: INFO networking_nsxv3.common.synchronization [req-590af88f-bde7-4f20-a821-3d354f1c0454 req-1bcb97e2-5bce-401d-a06d-fb143cde459e tempest-InstanceActionsNegativeTestJSON-382922751 tempest-InstanceActionsNegativeTestJSON-382922751-project-member] Enqueued Resource ID: 228de352-6a6b-498f-b01b-4fc933940457 with Priority: HIGHEST for action security_group_members [ 682.228206] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 228de352-6a6b-498f-b01b-4fc933940457 with Priority: HIGHEST for action security_group_members [ 682.232382] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-228de352-6a6b-498f-b01b-4fc933940457 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.232382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.232382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.232382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.232382] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.232382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.232382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.232382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.234588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.234746] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('228de352-6a6b-498f-b01b-4fc933940457',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.243118] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.243118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.694648] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-703 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.695552] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-703" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.695552] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-703" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.695552] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-703" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.695552] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.695718] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.695811] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.696030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.696228] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.696420] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.696533] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.696623] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.696727] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.696836] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.696940] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.697077] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.719377] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.723153] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.723153] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.723153] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-703" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.723153] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-b84edfae-0f54-42b6-99a8-f767333d7360 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.723153] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-b84edfae-0f54-42b6-99a8-f767333d7360" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.723153] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-b84edfae-0f54-42b6-99a8-f767333d7360" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.723153] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-b84edfae-0f54-42b6-99a8-f767333d7360" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.723153] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b84edfae-0f54-42b6-99a8-f767333d7360',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.739297] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.739297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.739297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.739297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.740631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.740631] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.740631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.740631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.740631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.740631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.740631] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 228de352-6a6b-498f-b01b-4fc933940457 already deleted. [ 682.740631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.225112] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.225547] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.225547] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.225775] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.226058] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.226154] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port b84edfae-0f54-42b6-99a8-f767333d7360 not found, creating... [ 683.226504] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.226504] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.226737] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.227118] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.227118] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.227255] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.227404] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.227862] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.227862] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.227862] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.227978] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: b84edfae-0f54-42b6-99a8-f767333d7360 is going to be created. [ 683.251770] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.251770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.251770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.251770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.251770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.251770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-b84edfae-0f54-42b6-99a8-f767333d7360" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.309429] env[62909]: INFO networking_nsxv3.common.synchronization [None req-8e00e0b6-6dbe-42d3-80b0-ba44739c3e49 None None] Enqueued Resource ID: 0e7efc82-54e2-44d0-bdd3-f0c7c3955262 with Priority: HIGHEST for action port [ 683.309429] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7efc82-54e2-44d0-bdd3-f0c7c3955262 with Priority: HIGHEST for action port [ 683.309829] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e7efc82-54e2-44d0-bdd3-f0c7c3955262 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.309929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e7efc82-54e2-44d0-bdd3-f0c7c3955262" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.310017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e7efc82-54e2-44d0-bdd3-f0c7c3955262" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.311195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e7efc82-54e2-44d0-bdd3-f0c7c3955262" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.311195] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e7efc82-54e2-44d0-bdd3-f0c7c3955262',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.404538] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 683.404538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.404538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.404538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.404538] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.404842] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.404842] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.404931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.405095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.405095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.405181] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.816353] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e7efc82-54e2-44d0-bdd3-f0c7c3955262 [ 683.816603] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.816729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.816799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.817087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.817183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.817360] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e7efc82-54e2-44d0-bdd3-f0c7c3955262 already deleted. [ 683.817360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e7efc82-54e2-44d0-bdd3-f0c7c3955262" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.909554] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.909717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.909811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.910052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.910250] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.910370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.910577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.910643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.910687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.910773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.910904] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.911064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.911064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.911193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.911331] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.911418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.911589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.911634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.911676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.911744] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.911831] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.036255] env[62909]: INFO networking_nsxv3.common.synchronization [req-590af88f-bde7-4f20-a821-3d354f1c0454 req-d247bcac-a4c3-4d68-ad0f-68314e847f34 service nova] Enqueued Resource ID: 228de352-6a6b-498f-b01b-4fc933940457 with Priority: HIGHEST for action security_group_rules [ 684.036423] env[62909]: INFO networking_nsxv3.common.synchronization [req-590af88f-bde7-4f20-a821-3d354f1c0454 req-d247bcac-a4c3-4d68-ad0f-68314e847f34 service nova] Enqueued Resource ID: 228de352-6a6b-498f-b01b-4fc933940457 with Priority: HIGHEST for action security_group_members [ 684.036552] env[62909]: INFO networking_nsxv3.common.synchronization [req-590af88f-bde7-4f20-a821-3d354f1c0454 req-d247bcac-a4c3-4d68-ad0f-68314e847f34 service nova] Enqueued Resource ID: b84edfae-0f54-42b6-99a8-f767333d7360 with Priority: HIGHEST for action port [ 684.036819] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 228de352-6a6b-498f-b01b-4fc933940457 with Priority: HIGHEST for action security_group_rules [ 684.038680] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 228de352-6a6b-498f-b01b-4fc933940457 with Priority: HIGHEST for action security_group_members [ 684.038680] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b84edfae-0f54-42b6-99a8-f767333d7360 with Priority: HIGHEST for action port [ 684.041944] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-228de352-6a6b-498f-b01b-4fc933940457 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.042146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.042215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.042525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.042525] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('228de352-6a6b-498f-b01b-4fc933940457',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.043466] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-228de352-6a6b-498f-b01b-4fc933940457 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.043577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.043972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.043972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.044272] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.044272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.044272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.044366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.044428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.044533] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('228de352-6a6b-498f-b01b-4fc933940457',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.049813] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b84edfae-0f54-42b6-99a8-f767333d7360 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.049813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b84edfae-0f54-42b6-99a8-f767333d7360" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.049813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b84edfae-0f54-42b6-99a8-f767333d7360" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.049940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b84edfae-0f54-42b6-99a8-f767333d7360" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.050067] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b84edfae-0f54-42b6-99a8-f767333d7360',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.420020] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 037af277-a74d-482c-b3ec-c4b5f5f92980: rpc.has_security_group_logging(os_id): False [ 684.438422] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.438627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.438691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.438913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.439098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.439344] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.439495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.439546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.439715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.439871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.440099] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.440099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.440264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.440358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.440384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.440573] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.440669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.440741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.440865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.440939] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.441298] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be updated. [ 684.475851] env[62909]: INFO networking_nsxv3.common.synchronization [req-fad9b4ba-124d-4c61-9461-c8a3c8bda0de req-d1a9b31f-a5b9-49ae-b08e-1740cbf7fe33 tempest-SecurityGroupRulesNegativeTestJSON-1311448310 tempest-SecurityGroupRulesNegativeTestJSON-1311448310-project-member] Enqueued Resource ID: 123e20a8-293e-4f91-9eca-67262ae0544a with Priority: HIGHEST for action security_group_rules [ 684.476654] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123e20a8-293e-4f91-9eca-67262ae0544a with Priority: HIGHEST for action security_group_rules [ 684.477630] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-123e20a8-293e-4f91-9eca-67262ae0544a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.477630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-123e20a8-293e-4f91-9eca-67262ae0544a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.477630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-123e20a8-293e-4f91-9eca-67262ae0544a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.478089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-123e20a8-293e-4f91-9eca-67262ae0544a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.478089] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('123e20a8-293e-4f91-9eca-67262ae0544a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.543587] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.543587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.543587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.543587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.543587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.552453] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-228de352-6a6b-498f-b01b-4fc933940457 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.552753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.553048] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('228de352-6a6b-498f-b01b-4fc933940457',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.554419] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b84edfae-0f54-42b6-99a8-f767333d7360 with status ACTIVE [ 684.554419] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.554615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.554708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.554952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.555177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.555386] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.555588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.555651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.555862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.556093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.556329] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.556460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.556611] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.556772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.556901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.557101] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b84edfae-0f54-42b6-99a8-f767333d7360 is going to be updated. [ 684.584381] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: IN_PROGRESS for 2s [ 684.597851] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.598043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.598124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.598287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.598430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.598679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b84edfae-0f54-42b6-99a8-f767333d7360" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.919270] env[62909]: INFO networking_nsxv3.common.synchronization [req-55d25424-7aca-4b14-b096-35ac352d99dc req-27cefa62-d449-43a9-ad5d-1f9022c7e20b tempest-AttachInterfacesV270Test-2074000085 tempest-AttachInterfacesV270Test-2074000085-project-member] Enqueued Resource ID: bef0125d-be94-4dc6-922c-269322ae2b97 with Priority: HIGHEST for action security_group_members [ 684.919270] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef0125d-be94-4dc6-922c-269322ae2b97 with Priority: HIGHEST for action security_group_members [ 684.919270] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef0125d-be94-4dc6-922c-269322ae2b97 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.919270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.919270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.919270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.919270] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.919270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.919943] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.920827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.921033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.921206] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bef0125d-be94-4dc6-922c-269322ae2b97',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.019399] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.019592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.019632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.019926] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.020068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.020162] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 123e20a8-293e-4f91-9eca-67262ae0544a already deleted. [ 685.020162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-123e20a8-293e-4f91-9eca-67262ae0544a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.058706] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('228de352-6a6b-498f-b01b-4fc933940457',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.068624] env[62909]: INFO networking_nsxv3.common.synchronization [req-7f2bdc31-7520-488e-8833-fbfc1eabea22 req-417dfc92-b60e-4201-b210-c597d028c21a tempest-ServerTagsTestJSON-331705066 tempest-ServerTagsTestJSON-331705066-project-member] Enqueued Resource ID: d6981999-a42c-4650-befd-1111c3f609ec with Priority: HIGHEST for action security_group_members [ 685.069411] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6981999-a42c-4650-befd-1111c3f609ec with Priority: HIGHEST for action security_group_members [ 685.069892] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6981999-a42c-4650-befd-1111c3f609ec taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.069892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.069892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.070343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.070510] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.070610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.070672] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.070836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.070921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.071020] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6981999-a42c-4650-befd-1111c3f609ec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.279052] env[62909]: INFO networking_nsxv3.common.synchronization [req-9b349380-e4d8-4c37-ba3f-5e45a94a058a req-6d6ef717-0bf5-40d0-b8db-5fa9056b5db9 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 685.280272] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 685.280706] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.281149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.281222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.284424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.284424] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.284424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.284424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.284424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.284424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.284424] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.424989] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.424989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.424989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.425273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.425413] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.425609] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.425774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.425957] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.426088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.426193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.426276] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef0125d-be94-4dc6-922c-269322ae2b97 is going to be updated. [ 685.457557] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.457557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.457557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.457557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.457557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.468029] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef0125d-be94-4dc6-922c-269322ae2b97 in Status: IN_PROGRESS for 2s [ 685.568025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.568687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.568902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.569250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.569508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.569701] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 228de352-6a6b-498f-b01b-4fc933940457 is going to be created. [ 685.576537] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.576537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.576537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.576537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.576537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.576537] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.576537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.576537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.576537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.576537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.576537] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6981999-a42c-4650-befd-1111c3f609ec is going to be updated. [ 685.600096] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.600096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.600096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.600096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.600096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.604122] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.604122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.604122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.604122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.604122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.612171] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6981999-a42c-4650-befd-1111c3f609ec in Status: IN_PROGRESS for 2s [ 685.618011] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 228de352-6a6b-498f-b01b-4fc933940457 in Status: UNINITIALIZED for 2s [ 685.785150] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.785319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.785391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.785608] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.785706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.785904] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.786009] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.786080] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.786255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.786338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.786433] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 685.830611] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.830791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.831255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.831255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.831532] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.843835] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 685.941051] env[62909]: INFO networking_nsxv3.common.synchronization [req-cda83df6-9f6f-4d2d-8666-f57225e39bcd req-559d7a34-b6f6-4812-94d5-457cb3e12376 tempest-SecurityGroupRulesNegativeTestJSON-1311448310 tempest-SecurityGroupRulesNegativeTestJSON-1311448310-project-member] Enqueued Resource ID: 123e20a8-293e-4f91-9eca-67262ae0544a with Priority: HIGHEST for action security_group_rules [ 685.941862] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123e20a8-293e-4f91-9eca-67262ae0544a with Priority: HIGHEST for action security_group_rules [ 685.942325] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-123e20a8-293e-4f91-9eca-67262ae0544a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.942501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-123e20a8-293e-4f91-9eca-67262ae0544a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.942731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-123e20a8-293e-4f91-9eca-67262ae0544a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.942890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-123e20a8-293e-4f91-9eca-67262ae0544a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.943022] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('123e20a8-293e-4f91-9eca-67262ae0544a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.030722] env[62909]: INFO networking_nsxv3.common.synchronization [req-53bfaca2-4902-4486-b436-3bab427ff788 req-6b718d45-19ea-474b-ab3b-ed4966836934 tempest-ServerAddressesNegativeTestJSON-977920271 tempest-ServerAddressesNegativeTestJSON-977920271-project-member] Enqueued Resource ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 with Priority: HIGHEST for action security_group_members [ 686.033463] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 with Priority: HIGHEST for action security_group_members [ 686.034651] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3153bb13-485b-4639-83ed-2a27b9bcedf0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.034803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.034895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.035090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.035259] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.035377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.035419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.035794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.036039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.036039] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3153bb13-485b-4639-83ed-2a27b9bcedf0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.382791] env[62909]: INFO networking_nsxv3.common.synchronization [req-46b716ed-2097-42ed-8db8-066ff85c5c02 req-2d5ce937-10df-4bfa-994c-f15bf0b6b44a tempest-VolumesAssistedSnapshotsTest-1541736566 tempest-VolumesAssistedSnapshotsTest-1541736566-project-member] Enqueued Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_members [ 686.384200] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGHEST for action security_group_members [ 686.384200] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2821bc4-3047-4598-bd51-10cd2a5b1137 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.384200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.384200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.388327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.388327] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.388327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.388327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.388327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.388327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.388327] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.469442] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.472192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.472390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.472677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.472926] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.473091] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 123e20a8-293e-4f91-9eca-67262ae0544a already deleted. [ 686.473220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-123e20a8-293e-4f91-9eca-67262ae0544a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.539235] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.539972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.539972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.539972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.539972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.540174] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.540174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.540174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.540327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.540359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.540480] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 is going to be updated. [ 686.566558] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.566558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.566697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.566780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.566930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.578229] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 in Status: IN_PROGRESS for 2s [ 686.600786] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 686.601961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.892081] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.892690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.892690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.892690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.892690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.892834] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.892954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.893544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.893544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.894253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.894253] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 is going to be updated. [ 686.927453] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.927453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.927453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.927747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.927747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.941516] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 in Status: IN_PROGRESS for 2s [ 687.479920] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef0125d-be94-4dc6-922c-269322ae2b97 in Status: SUCCESS [ 687.480504] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef0125d-be94-4dc6-922c-269322ae2b97 deletion is rescheduled due to dependency. [ 687.480504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.622397] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6981999-a42c-4650-befd-1111c3f609ec in Status: SUCCESS [ 687.622604] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6981999-a42c-4650-befd-1111c3f609ec deletion is rescheduled due to dependency. [ 687.623022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.625877] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 228de352-6a6b-498f-b01b-4fc933940457 in Status: SUCCESS [ 687.626086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.626237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.626445] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.626627] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.626743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.626836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.626959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.627132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.627132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.627244] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('228de352-6a6b-498f-b01b-4fc933940457',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.856044] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 687.856217] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 deletion is rescheduled due to dependency. [ 687.856335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.131798] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-228de352-6a6b-498f-b01b-4fc933940457 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.132124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.132124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.132227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.132390] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.132493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.132553] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.132703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.132787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.132871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.133027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-228de352-6a6b-498f-b01b-4fc933940457 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.133124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.133191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.133370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.133533] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.133597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.133654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.133788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.133863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.133985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.134057] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('228de352-6a6b-498f-b01b-4fc933940457',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.591725] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 in Status: SUCCESS [ 688.591725] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 deletion is rescheduled due to dependency. [ 688.591725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.639929] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 228de352-6a6b-498f-b01b-4fc933940457: rpc.has_security_group_logging(os_id): False [ 688.657631] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.660018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.660018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.660018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.660599] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.663769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.663769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.663769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.663769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.663769] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 228de352-6a6b-498f-b01b-4fc933940457 is going to be created. [ 688.744710] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.744924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.745041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.745368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.746412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.764362] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 228de352-6a6b-498f-b01b-4fc933940457 in Status: IN_PROGRESS for 2s [ 688.952981] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 in Status: SUCCESS [ 688.952981] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 deletion is rescheduled due to dependency. [ 688.952981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.236174] env[62909]: INFO networking_nsxv3.common.synchronization [req-f6e2318b-ef47-49a3-9672-5d71c95e418c req-48946b0e-733c-4487-bf00-bc802ed13661 tempest-ServersWithSpecificFlavorTestJSON-184799251 tempest-ServersWithSpecificFlavorTestJSON-184799251-project-member] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 689.236174] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 689.236174] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.236174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.236174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.236174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.236174] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.236174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.236174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.237717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.238056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.238733] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.679717] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.680018] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-714" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.680123] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-714" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.680465] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-714" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.681397] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.681397] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.681397] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.682195] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.682410] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.682661] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.682811] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.683241] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.683396] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.683925] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.684164] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.684474] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.713439] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.713678] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 689.713861] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.714060] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-714" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.715029] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-ba331d08-bcc1-4f3e-b972-ee660dd6c0db taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.715029] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-ba331d08-bcc1-4f3e-b972-ee660dd6c0db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.715029] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-ba331d08-bcc1-4f3e-b972-ee660dd6c0db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.715029] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-ba331d08-bcc1-4f3e-b972-ee660dd6c0db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.715345] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba331d08-bcc1-4f3e-b972-ee660dd6c0db',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.742940] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.742940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.742940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.742940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.742940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.742940] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.742940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.742940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.742940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.742940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.742940] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 is going to be updated. [ 689.777042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.777042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.777042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.777042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.777042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.786793] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: IN_PROGRESS for 2s [ 690.218679] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.218903] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.219076] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.219454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.219527] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.219672] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port ba331d08-bcc1-4f3e-b972-ee660dd6c0db not found, creating... [ 690.220181] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.220181] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.220344] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.220473] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.220567] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.220848] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.221012] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.221135] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.221334] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.221635] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.221635] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: ba331d08-bcc1-4f3e-b972-ee660dd6c0db is going to be created. [ 690.246155] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.246478] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.246520] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.246815] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.247111] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.247537] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-ba331d08-bcc1-4f3e-b972-ee660dd6c0db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.580669] env[62909]: INFO networking_nsxv3.common.synchronization [req-bf262e5d-a35d-4ab5-a1db-1170d50ce125 req-86f0e223-4e5f-4535-82a1-9a1a1eca04f1 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_members [ 690.581477] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGHEST for action security_group_members [ 690.581477] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-b723f584-c976-4351-bfcd-6ca761e670dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.581639] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.581735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.585017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.585017] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.585017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.585017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.585017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.585017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.585017] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.777458] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 228de352-6a6b-498f-b01b-4fc933940457 in Status: SUCCESS [ 690.777668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.002250] env[62909]: INFO networking_nsxv3.common.synchronization [req-f6e2318b-ef47-49a3-9672-5d71c95e418c req-23b48b02-d0c5-4f84-ad45-62a20a71156c service nova] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_rules [ 691.002250] env[62909]: INFO networking_nsxv3.common.synchronization [req-f6e2318b-ef47-49a3-9672-5d71c95e418c req-23b48b02-d0c5-4f84-ad45-62a20a71156c service nova] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 691.002250] env[62909]: INFO networking_nsxv3.common.synchronization [req-f6e2318b-ef47-49a3-9672-5d71c95e418c req-23b48b02-d0c5-4f84-ad45-62a20a71156c service nova] Enqueued Resource ID: ba331d08-bcc1-4f3e-b972-ee660dd6c0db with Priority: HIGHEST for action port [ 691.002250] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_rules [ 691.002250] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 691.002250] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba331d08-bcc1-4f3e-b972-ee660dd6c0db with Priority: HIGHEST for action port [ 691.002712] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.003809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.004103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.004488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.004654] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.005640] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.005895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.006254] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba331d08-bcc1-4f3e-b972-ee660dd6c0db taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.006494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba331d08-bcc1-4f3e-b972-ee660dd6c0db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.006633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba331d08-bcc1-4f3e-b972-ee660dd6c0db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.007017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba331d08-bcc1-4f3e-b972-ee660dd6c0db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.007197] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba331d08-bcc1-4f3e-b972-ee660dd6c0db',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.086880] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.089392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.089392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.089392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.089392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.089392] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.089392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.089392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.089392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.089392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.089392] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b723f584-c976-4351-bfcd-6ca761e670dd is going to be updated. [ 691.117798] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.118089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.118089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.118220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.118425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.129984] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b723f584-c976-4351-bfcd-6ca761e670dd in Status: IN_PROGRESS for 2s [ 691.509667] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.510097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.513217] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba331d08-bcc1-4f3e-b972-ee660dd6c0db with status ACTIVE [ 691.513498] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.513731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.513843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.514118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.514277] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.514480] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.514650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.514727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.515017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.515072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.515324] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.515457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.515572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.515737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.515856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.515953] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba331d08-bcc1-4f3e-b972-ee660dd6c0db is going to be updated. [ 691.541404] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.541534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.541591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.541760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.541890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.542407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba331d08-bcc1-4f3e-b972-ee660dd6c0db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.797557] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: SUCCESS [ 691.797557] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 deletion is rescheduled due to dependency. [ 691.797557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.797557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.797557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.797808] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.797875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.797908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.798130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.798227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.798321] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.302095] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.804403] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.141583] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b723f584-c976-4351-bfcd-6ca761e670dd in Status: SUCCESS [ 693.142474] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b723f584-c976-4351-bfcd-6ca761e670dd deletion is rescheduled due to dependency. [ 693.142848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.307305] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.310589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.310589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.310589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.310589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.310589] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 is going to be updated. [ 693.366490] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.367216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.367216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.367216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.367216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.379540] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: IN_PROGRESS for 2s [ 695.276295] env[62909]: INFO networking_nsxv3.common.synchronization [req-3d313a15-2e7a-4899-b76d-e8f04132a31c req-1e0e3d47-8a84-4faf-9aed-dee9949616d0 tempest-InstanceActionsNegativeTestJSON-382922751 tempest-InstanceActionsNegativeTestJSON-382922751-project-member] Enqueued Resource ID: 228de352-6a6b-498f-b01b-4fc933940457 with Priority: HIGHEST for action security_group_members [ 695.276295] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 228de352-6a6b-498f-b01b-4fc933940457 with Priority: HIGHEST for action security_group_members [ 695.277601] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-228de352-6a6b-498f-b01b-4fc933940457 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.278136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.278588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.278864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.279377] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.280189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.280356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.280743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.280983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.281348] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('228de352-6a6b-498f-b01b-4fc933940457',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.393561] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: SUCCESS [ 695.393561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.393561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.393561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.393561] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.393561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.393561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.394829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.394829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.394829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.394829] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.788254] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.789028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.789569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.789569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.789569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.789873] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.790013] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.791200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.791200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.791200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.791200] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 228de352-6a6b-498f-b01b-4fc933940457 is going to be updated. [ 695.825689] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.825832] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.825904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.826185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.826388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.839466] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 228de352-6a6b-498f-b01b-4fc933940457 in Status: IN_PROGRESS for 2s [ 695.903168] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.408166] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a79ba361-9edb-4b9b-82c4-afa586cb4427: rpc.has_security_group_logging(os_id): False [ 696.436782] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.436782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.436782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.436782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.436782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.436782] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.436782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.436782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.436782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.436782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.436782] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 is going to be updated. [ 696.517457] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.517666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.517666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.517853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.518009] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.535319] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: IN_PROGRESS for 2s [ 696.814504] env[62909]: INFO networking_nsxv3.common.synchronization [None req-44d8635d-9f5a-4444-bfde-a215bd5d56a9 None None] Enqueued Resource ID: ae83c1d5-c1d9-445c-b040-2e0b4cf4c3d5 with Priority: HIGHEST for action port [ 696.814504] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae83c1d5-c1d9-445c-b040-2e0b4cf4c3d5 with Priority: HIGHEST for action port [ 696.815027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae83c1d5-c1d9-445c-b040-2e0b4cf4c3d5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.815467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae83c1d5-c1d9-445c-b040-2e0b4cf4c3d5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.815760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae83c1d5-c1d9-445c-b040-2e0b4cf4c3d5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.816324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae83c1d5-c1d9-445c-b040-2e0b4cf4c3d5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.816642] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae83c1d5-c1d9-445c-b040-2e0b4cf4c3d5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.319426] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae83c1d5-c1d9-445c-b040-2e0b4cf4c3d5 [ 697.319653] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.319785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 697.319852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.320130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 697.320198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 697.320303] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae83c1d5-c1d9-445c-b040-2e0b4cf4c3d5 already deleted. [ 697.320385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae83c1d5-c1d9-445c-b040-2e0b4cf4c3d5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 697.850359] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 228de352-6a6b-498f-b01b-4fc933940457 in Status: SUCCESS [ 697.850359] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 228de352-6a6b-498f-b01b-4fc933940457 deletion is rescheduled due to dependency. [ 697.850359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 697.862530] env[62909]: INFO networking_nsxv3.common.synchronization [req-1acc1fa8-cd69-4ca3-8237-e266e10487ad req-d5065702-c5a4-49cb-8347-adeff1e286cf tempest-SecurityGroupRulesTestJSON-667404217 tempest-SecurityGroupRulesTestJSON-667404217-project-member] Enqueued Resource ID: 04b2760e-1935-4bbe-8f78-9cd48d681717 with Priority: HIGHEST for action security_group_rules [ 697.863424] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04b2760e-1935-4bbe-8f78-9cd48d681717 with Priority: HIGHEST for action security_group_rules [ 697.863424] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04b2760e-1935-4bbe-8f78-9cd48d681717 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.863528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04b2760e-1935-4bbe-8f78-9cd48d681717" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 697.863528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04b2760e-1935-4bbe-8f78-9cd48d681717" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.863781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04b2760e-1935-4bbe-8f78-9cd48d681717" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 697.863861] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04b2760e-1935-4bbe-8f78-9cd48d681717',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.363105] env[62909]: INFO networking_nsxv3.common.synchronization [req-36799ff7-c5ff-4c1b-93f2-63984d3f57ca req-88149ab6-12ff-4e40-b47b-17d31abcfa97 tempest-SecurityGroupRulesTestJSON-667404217 tempest-SecurityGroupRulesTestJSON-667404217-project-member] Enqueued Resource ID: e43dbfa0-27ee-44f5-bbac-260651001ca6 with Priority: HIGHEST for action security_group_rules [ 698.363105] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e43dbfa0-27ee-44f5-bbac-260651001ca6 with Priority: HIGHEST for action security_group_rules [ 698.363236] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e43dbfa0-27ee-44f5-bbac-260651001ca6 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.363355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e43dbfa0-27ee-44f5-bbac-260651001ca6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.363418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e43dbfa0-27ee-44f5-bbac-260651001ca6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.363652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e43dbfa0-27ee-44f5-bbac-260651001ca6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.363731] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e43dbfa0-27ee-44f5-bbac-260651001ca6',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.386435] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.386529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.386561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.386750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.386838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.386927] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04b2760e-1935-4bbe-8f78-9cd48d681717 already deleted. [ 698.387087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04b2760e-1935-4bbe-8f78-9cd48d681717" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.547520] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: SUCCESS [ 698.547751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.887372] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.887372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.887372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.887692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.887692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.887692] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e43dbfa0-27ee-44f5-bbac-260651001ca6 already deleted. [ 698.887770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e43dbfa0-27ee-44f5-bbac-260651001ca6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.215034] env[62909]: INFO networking_nsxv3.common.synchronization [req-c6d21aab-1123-4338-8be5-b7f4d61e5779 req-e1e91457-0f3d-4f62-9b89-0d5e0622e044 tempest-SecurityGroupRulesTestJSON-667404217 tempest-SecurityGroupRulesTestJSON-667404217-project-member] Enqueued Resource ID: 4971c637-9226-403a-9d4f-eb400a2a13cb with Priority: HIGHEST for action security_group_rules [ 699.215573] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4971c637-9226-403a-9d4f-eb400a2a13cb with Priority: HIGHEST for action security_group_rules [ 699.215872] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4971c637-9226-403a-9d4f-eb400a2a13cb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.215993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4971c637-9226-403a-9d4f-eb400a2a13cb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.216090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4971c637-9226-403a-9d4f-eb400a2a13cb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.216332] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4971c637-9226-403a-9d4f-eb400a2a13cb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.216484] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4971c637-9226-403a-9d4f-eb400a2a13cb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.743117] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.743117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.743117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.743117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.743117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.743117] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4971c637-9226-403a-9d4f-eb400a2a13cb already deleted. [ 699.743117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4971c637-9226-403a-9d4f-eb400a2a13cb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.116906] env[62909]: INFO networking_nsxv3.common.synchronization [None req-dd60d1a0-b615-4e70-bd43-11c1f2ae97e5 None None] Enqueued Resource ID: 91379ad7-d173-4301-9c21-badbbc346940 with Priority: HIGHEST for action port [ 700.117345] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91379ad7-d173-4301-9c21-badbbc346940 with Priority: HIGHEST for action port [ 700.118467] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-91379ad7-d173-4301-9c21-badbbc346940 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.118603] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91379ad7-d173-4301-9c21-badbbc346940" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.118687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91379ad7-d173-4301-9c21-badbbc346940" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.118971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91379ad7-d173-4301-9c21-badbbc346940" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.119185] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91379ad7-d173-4301-9c21-badbbc346940',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.185770] env[62909]: INFO networking_nsxv3.common.synchronization [req-74eb8270-1120-471d-b107-bcfcd886ef28 req-f20fee39-fe17-4cee-b64c-73b44eb218b5 tempest-SecurityGroupRulesTestJSON-667404217 tempest-SecurityGroupRulesTestJSON-667404217-project-member] Enqueued Resource ID: e739b59a-0c0a-4da9-bdb5-49dd8a4e5286 with Priority: HIGHEST for action security_group_rules [ 700.186108] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e739b59a-0c0a-4da9-bdb5-49dd8a4e5286 with Priority: HIGHEST for action security_group_rules [ 700.186436] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e739b59a-0c0a-4da9-bdb5-49dd8a4e5286 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.186552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e739b59a-0c0a-4da9-bdb5-49dd8a4e5286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.186617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e739b59a-0c0a-4da9-bdb5-49dd8a4e5286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.186861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e739b59a-0c0a-4da9-bdb5-49dd8a4e5286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.186968] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e739b59a-0c0a-4da9-bdb5-49dd8a4e5286',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.621102] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91379ad7-d173-4301-9c21-badbbc346940 [ 700.621373] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.621509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.621639] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.621785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.621875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.621964] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91379ad7-d173-4301-9c21-badbbc346940 already deleted. [ 700.622099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91379ad7-d173-4301-9c21-badbbc346940" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.709786] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.709918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.709990] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.710289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.710351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.710409] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e739b59a-0c0a-4da9-bdb5-49dd8a4e5286 already deleted. [ 700.710514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e739b59a-0c0a-4da9-bdb5-49dd8a4e5286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.135150] env[62909]: INFO networking_nsxv3.common.synchronization [req-462c208d-9df7-48bf-bf83-9729cba3b5d2 req-62577245-1906-41fe-9164-3101358372f2 tempest-SecurityGroupRulesTestJSON-667404217 tempest-SecurityGroupRulesTestJSON-667404217-project-member] Enqueued Resource ID: 769347fb-a350-4155-8754-cd1ad7756ab4 with Priority: HIGHEST for action security_group_rules [ 701.135660] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769347fb-a350-4155-8754-cd1ad7756ab4 with Priority: HIGHEST for action security_group_rules [ 701.135954] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-769347fb-a350-4155-8754-cd1ad7756ab4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.136087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.136155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.136410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.136491] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('769347fb-a350-4155-8754-cd1ad7756ab4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.304774] env[62909]: INFO networking_nsxv3.common.synchronization [req-8c67ae20-8865-4422-9f29-04b033ad1e66 req-63305840-69a6-42dc-8eba-bd1ee81fdcce tempest-SecurityGroupRulesTestJSON-667404217 tempest-SecurityGroupRulesTestJSON-667404217-project-member] Enqueued Resource ID: 769347fb-a350-4155-8754-cd1ad7756ab4 with Priority: HIGHEST for action security_group_rules [ 701.305291] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769347fb-a350-4155-8754-cd1ad7756ab4 with Priority: HIGHEST for action security_group_rules [ 701.305586] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-769347fb-a350-4155-8754-cd1ad7756ab4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.305689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.542991] env[62909]: INFO networking_nsxv3.common.synchronization [req-50dfacf6-5a48-4fa4-ba77-e57ad5c9c1c9 req-fb0c2a11-a6c7-42fb-a54d-dab55fcb378b tempest-SecurityGroupRulesTestJSON-667404217 tempest-SecurityGroupRulesTestJSON-667404217-project-member] Enqueued Resource ID: 769347fb-a350-4155-8754-cd1ad7756ab4 with Priority: HIGHEST for action security_group_rules [ 701.543504] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769347fb-a350-4155-8754-cd1ad7756ab4 with Priority: HIGHEST for action security_group_rules [ 701.543804] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-769347fb-a350-4155-8754-cd1ad7756ab4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.543903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.664091] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.664352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.664352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.664521] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.664614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.664707] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 769347fb-a350-4155-8754-cd1ad7756ab4 already deleted. [ 701.664787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.664943] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.665117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.665206] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('769347fb-a350-4155-8754-cd1ad7756ab4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.186465] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.186465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.186465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.186465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.186465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.186465] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 769347fb-a350-4155-8754-cd1ad7756ab4 already deleted. [ 702.186465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.186465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.186465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.186465] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('769347fb-a350-4155-8754-cd1ad7756ab4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.707009] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.707223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.707288] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.707543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.707640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.707739] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 769347fb-a350-4155-8754-cd1ad7756ab4 already deleted. [ 702.707821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-769347fb-a350-4155-8754-cd1ad7756ab4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.546836] env[62909]: INFO networking_nsxv3.common.synchronization [req-6d1c2586-7872-40f5-8d4b-13f34b7b71e7 req-4f2015de-1fb1-4deb-8bcf-3bab501b21eb tempest-ServersTestManualDisk-1910117612 tempest-ServersTestManualDisk-1910117612-project-member] Enqueued Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_members [ 703.548297] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_members [ 703.548297] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-35857353-01c5-40e5-800e-946a46ca0fc9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.548638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.549522] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.549811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.549996] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.550263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.550263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.550365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.550468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.551166] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.054925] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.055243] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.055243] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.055546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.055657] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.055868] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.055972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.056047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.056242] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.056312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.056389] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35857353-01c5-40e5-800e-946a46ca0fc9 already deleted. [ 704.056455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.093360] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-750 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.093598] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-750" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.093728] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-750" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.094059] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-750" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.094358] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.094541] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.094660] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.094883] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.095048] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.095269] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.095394] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.095505] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.095615] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.095731] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.095828] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.095963] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.117988] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.117988] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.118192] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.118232] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-750" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.118546] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-df40a274-9dea-4b4c-be39-6e7556e77032 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.118713] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-df40a274-9dea-4b4c-be39-6e7556e77032" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.118827] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-df40a274-9dea-4b4c-be39-6e7556e77032" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.119219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-df40a274-9dea-4b4c-be39-6e7556e77032" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.119512] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df40a274-9dea-4b4c-be39-6e7556e77032',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.622166] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.622559] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.622559] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.623291] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.623291] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.623291] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port df40a274-9dea-4b4c-be39-6e7556e77032 not found, creating... [ 704.623720] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.623901] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.624029] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.624276] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.624423] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.624726] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.624884] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.625016] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.625239] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.625662] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.626094] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: df40a274-9dea-4b4c-be39-6e7556e77032 is going to be created. [ 704.651705] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.651705] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.651705] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.651705] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.651705] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.651705] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-df40a274-9dea-4b4c-be39-6e7556e77032" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.588935] env[62909]: INFO networking_nsxv3.common.synchronization [req-6d1c2586-7872-40f5-8d4b-13f34b7b71e7 req-68a760a8-9774-4cdf-9843-d3b3d058cbdd service nova] Enqueued Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_rules [ 705.589121] env[62909]: INFO networking_nsxv3.common.synchronization [req-6d1c2586-7872-40f5-8d4b-13f34b7b71e7 req-68a760a8-9774-4cdf-9843-d3b3d058cbdd service nova] Enqueued Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_members [ 705.589286] env[62909]: INFO networking_nsxv3.common.synchronization [req-6d1c2586-7872-40f5-8d4b-13f34b7b71e7 req-68a760a8-9774-4cdf-9843-d3b3d058cbdd service nova] Enqueued Resource ID: df40a274-9dea-4b4c-be39-6e7556e77032 with Priority: HIGHEST for action port [ 705.589519] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_rules [ 705.589644] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_members [ 705.589736] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df40a274-9dea-4b4c-be39-6e7556e77032 with Priority: HIGHEST for action port [ 705.590765] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35857353-01c5-40e5-800e-946a46ca0fc9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.590892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.590957] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.591170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.591250] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.593214] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-35857353-01c5-40e5-800e-946a46ca0fc9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.593214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.593214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.593214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.593214] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.593214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.593214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.593214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.593214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.593214] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.593729] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-df40a274-9dea-4b4c-be39-6e7556e77032 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.593803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df40a274-9dea-4b4c-be39-6e7556e77032" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.593803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df40a274-9dea-4b4c-be39-6e7556e77032" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.593978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df40a274-9dea-4b4c-be39-6e7556e77032" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.596102] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df40a274-9dea-4b4c-be39-6e7556e77032',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.098390] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-35857353-01c5-40e5-800e-946a46ca0fc9 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.098669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.098722] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.100091] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df40a274-9dea-4b4c-be39-6e7556e77032 with status ACTIVE [ 706.100994] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.100994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.100994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.100994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.100994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.100994] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.101351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.101351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.101351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.101351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.101539] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.101635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.101690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.101826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.101894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.102463] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df40a274-9dea-4b4c-be39-6e7556e77032 is going to be updated. [ 706.115928] env[62909]: INFO networking_nsxv3.common.synchronization [req-4c0c9db5-20d7-49cb-b5fa-752b34111a59 req-0b3fe98e-1b5c-4b9b-aab9-9c55c249ac1d tempest-ImagesTestJSON-652168268 tempest-ImagesTestJSON-652168268-project-member] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 706.115928] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 706.119899] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.119899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.119899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.119899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.119899] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.119899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.119899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.119899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.119899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.119899] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.126872] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.127118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.127212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.127443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.127613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.127804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df40a274-9dea-4b4c-be39-6e7556e77032" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.605035] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.627985] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.627985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.627985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.627985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.627985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.627985] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.628226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.628226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.628378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.628378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.628453] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 706.660133] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.660133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.660133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.660133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.660133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.669121] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 706.699554] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.699554] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.699554] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.699554] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.699554] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.699918] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.700207] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.700590] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.700869] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.701216] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.701454] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.701701] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.701940] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.702187] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.704058] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.704058] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.722369] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.722440] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 706.722596] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.722798] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.723154] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-6faadfd4-7bac-4fbc-a32f-f2742bdff1f6 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.723335] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-6faadfd4-7bac-4fbc-a32f-f2742bdff1f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.723450] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-6faadfd4-7bac-4fbc-a32f-f2742bdff1f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.723772] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-6faadfd4-7bac-4fbc-a32f-f2742bdff1f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.723905] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6faadfd4-7bac-4fbc-a32f-f2742bdff1f6',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.115878] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.116195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.116195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.116477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.117177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.117177] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35857353-01c5-40e5-800e-946a46ca0fc9 is going to be created. [ 707.143055] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.143229] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.143309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.143732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.143802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.153844] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35857353-01c5-40e5-800e-946a46ca0fc9 in Status: UNINITIALIZED for 2s [ 707.227583] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.227583] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.227583] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.227583] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.227583] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.227583] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 6faadfd4-7bac-4fbc-a32f-f2742bdff1f6 not found, creating... [ 707.228050] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.228050] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.228050] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.228585] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.228585] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.228732] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.228896] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.229017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.230104] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.230292] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.231359] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 6faadfd4-7bac-4fbc-a32f-f2742bdff1f6 is going to be created. [ 707.277377] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.277377] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.277377] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.278220] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.278220] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.278663] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-6faadfd4-7bac-4fbc-a32f-f2742bdff1f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.174219] env[62909]: INFO networking_nsxv3.common.synchronization [req-4c0c9db5-20d7-49cb-b5fa-752b34111a59 req-7a5fa8ed-ded3-450e-af43-6dae422c97e4 service nova] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_rules [ 708.174683] env[62909]: INFO networking_nsxv3.common.synchronization [req-4c0c9db5-20d7-49cb-b5fa-752b34111a59 req-7a5fa8ed-ded3-450e-af43-6dae422c97e4 service nova] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 708.174683] env[62909]: INFO networking_nsxv3.common.synchronization [req-4c0c9db5-20d7-49cb-b5fa-752b34111a59 req-7a5fa8ed-ded3-450e-af43-6dae422c97e4 service nova] Enqueued Resource ID: 6faadfd4-7bac-4fbc-a32f-f2742bdff1f6 with Priority: HIGHEST for action port [ 708.175542] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_rules [ 708.175619] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 708.175718] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6faadfd4-7bac-4fbc-a32f-f2742bdff1f6 with Priority: HIGHEST for action port [ 708.176034] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.176155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.176225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.176508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.176650] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.177762] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.177762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.180403] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-6faadfd4-7bac-4fbc-a32f-f2742bdff1f6 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.180403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6faadfd4-7bac-4fbc-a32f-f2742bdff1f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.180403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6faadfd4-7bac-4fbc-a32f-f2742bdff1f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.180403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6faadfd4-7bac-4fbc-a32f-f2742bdff1f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.180403] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6faadfd4-7bac-4fbc-a32f-f2742bdff1f6',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.680456] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 708.680456] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa deletion is rescheduled due to dependency. [ 708.680456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.684299] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.684472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.684527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.684852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.684930] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.685107] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.685154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.685386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.685386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.685474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.685566] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.687892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.688217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.691394] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.691394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.691394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.691394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.691394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.691394] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.691394] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6faadfd4-7bac-4fbc-a32f-f2742bdff1f6 with status ACTIVE [ 708.691394] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.691394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.691394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.691394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.691394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.691394] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.691394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.692240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.692240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.692240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.692240] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.692240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.692391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.692419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.692703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.692703] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6faadfd4-7bac-4fbc-a32f-f2742bdff1f6 is going to be updated. [ 708.716233] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.716387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.716450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.716675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.716821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.716988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6faadfd4-7bac-4fbc-a32f-f2742bdff1f6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.164848] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35857353-01c5-40e5-800e-946a46ca0fc9 in Status: SUCCESS [ 709.165072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.165236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.165462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.165645] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.165846] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.165846] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.165999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.166149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.166245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.166340] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.173902] env[62909]: INFO networking_nsxv3.common.synchronization [None req-8c01caa9-2e80-4009-9053-c8c4dcdb666d None None] Enqueued Resource ID: c4a240bf-24cd-47ff-860d-b51c15829603 with Priority: HIGHEST for action port [ 709.174249] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a240bf-24cd-47ff-860d-b51c15829603 with Priority: HIGHEST for action port [ 709.175020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4a240bf-24cd-47ff-860d-b51c15829603 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.177692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4a240bf-24cd-47ff-860d-b51c15829603" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.177692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4a240bf-24cd-47ff-860d-b51c15829603" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.177692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4a240bf-24cd-47ff-860d-b51c15829603" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.177692] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4a240bf-24cd-47ff-860d-b51c15829603',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.191043] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.191184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.194067] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.669928] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.678967] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4a240bf-24cd-47ff-860d-b51c15829603 [ 709.679090] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.679255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.679317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.679575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.679703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.679817] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4a240bf-24cd-47ff-860d-b51c15829603 already deleted. [ 709.680987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4a240bf-24cd-47ff-860d-b51c15829603" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.698155] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.170611] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35857353-01c5-40e5-800e-946a46ca0fc9: rpc.has_security_group_logging(os_id): False [ 710.191753] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.192117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.192117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.192185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.192258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.192525] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.192627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.192690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.192849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.192924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.193016] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35857353-01c5-40e5-800e-946a46ca0fc9 is going to be created. [ 710.200683] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.200891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.200989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.201312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.201346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.201454] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 710.250541] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.250697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.250801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.250971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.251133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.261425] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 710.288425] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.288640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.288640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.288843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.289036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.304720] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35857353-01c5-40e5-800e-946a46ca0fc9 in Status: IN_PROGRESS for 2s [ 710.475228] env[62909]: INFO networking_nsxv3.common.synchronization [req-412151e1-6e45-4d79-8d97-242295f24285 req-e08f5dc5-bf3a-47ae-bb85-60c8431a6468 tempest-ServersTestFqdnHostnames-2028362432 tempest-ServersTestFqdnHostnames-2028362432-project-member] Enqueued Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_members [ 710.475228] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 with Priority: HIGHEST for action security_group_members [ 710.475228] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-91426ce9-c57f-42ef-bcee-74c76f9876e0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.475228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.475228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.478096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.478096] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.478096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.478096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.478096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.478096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.478096] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91426ce9-c57f-42ef-bcee-74c76f9876e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.980016] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.980184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.980420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.980683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.980794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.981025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.981149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.981443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.981443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.981551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.981634] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 is going to be updated. [ 711.012314] env[62909]: INFO networking_nsxv3.common.synchronization [None req-d8857fee-cce3-444d-86ff-17a06b6eb163 tempest-ServersV294TestFqdnHostnames-1806071593 tempest-ServersV294TestFqdnHostnames-1806071593-project-member] Enqueued Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_rules [ 711.017629] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_rules [ 711.017629] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d35f16-322f-4fce-8671-2c59aba9257f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.017629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.017629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.017629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.017629] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d35f16-322f-4fce-8671-2c59aba9257f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.021226] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.021363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.021432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.021659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.021835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.033511] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 in Status: IN_PROGRESS for 2s [ 711.184793] env[62909]: INFO networking_nsxv3.common.synchronization [None req-fca5879f-1b78-4e9c-bb31-de8f482da69c tempest-ServersV294TestFqdnHostnames-1806071593 tempest-ServersV294TestFqdnHostnames-1806071593-project-member] Enqueued Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_rules [ 711.186632] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_rules [ 711.186632] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d35f16-322f-4fce-8671-2c59aba9257f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.186632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.422769] env[62909]: INFO networking_nsxv3.common.synchronization [None req-da22b1eb-65cc-4079-bfd3-09d8437c2a48 None None] Enqueued Resource ID: 2317efb0-6f58-474f-987e-c540134e12a3 with Priority: HIGHEST for action port [ 711.427703] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2317efb0-6f58-474f-987e-c540134e12a3 with Priority: HIGHEST for action port [ 711.427703] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-2317efb0-6f58-474f-987e-c540134e12a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.427703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2317efb0-6f58-474f-987e-c540134e12a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.427703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2317efb0-6f58-474f-987e-c540134e12a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.427703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2317efb0-6f58-474f-987e-c540134e12a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.427703] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2317efb0-6f58-474f-987e-c540134e12a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.550699] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.550699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.550699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.550699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.550699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.550699] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d35f16-322f-4fce-8671-2c59aba9257f already deleted. [ 711.550699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.550699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.550699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.550699] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d35f16-322f-4fce-8671-2c59aba9257f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.933230] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2317efb0-6f58-474f-987e-c540134e12a3 [ 711.934423] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.934886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.935309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.936043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.936043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.936043] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2317efb0-6f58-474f-987e-c540134e12a3 already deleted. [ 711.936296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2317efb0-6f58-474f-987e-c540134e12a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.058614] env[62909]: INFO networking_nsxv3.common.synchronization [req-bbaecb67-3608-42b4-9048-ef660eecc298 req-7ad98ccc-41e0-4ab4-ad88-7ea6400c5462 tempest-ImagesNegativeTestJSON-924451865 tempest-ImagesNegativeTestJSON-924451865-project-member] Enqueued Resource ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb with Priority: HIGHEST for action security_group_members [ 712.058937] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb with Priority: HIGHEST for action security_group_members [ 712.060960] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.060960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.060960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.060960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.060960] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.060960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.060960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.061325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.061325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.061325] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe2d83f4-67d0-4b35-90a2-f919bc3f65bb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.079317] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.079317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.079317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.079317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.079317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.079317] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d35f16-322f-4fce-8671-2c59aba9257f already deleted. [ 712.079317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.275248] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 712.277202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.277739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.279685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.279949] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.279949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.280122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.280265] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.280361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.280475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.280687] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.280795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.281322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.281322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.281322] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.281702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.281799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.281996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.282114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.282204] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.282317] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.319046] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35857353-01c5-40e5-800e-946a46ca0fc9 in Status: SUCCESS [ 712.319476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.564027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.564429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.564429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.564429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.564553] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.564760] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.564829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.565026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.565026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.565133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.565207] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb already deleted. [ 712.565290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.671410] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ddc8c870-9f64-4c69-b3d7-313c5781aa3b None None] Enqueued Resource ID: 41273e60-d1c2-4d99-bea4-40e82fe3e47a with Priority: HIGHEST for action port [ 712.672045] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41273e60-d1c2-4d99-bea4-40e82fe3e47a with Priority: HIGHEST for action port [ 712.672362] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-41273e60-d1c2-4d99-bea4-40e82fe3e47a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.672492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41273e60-d1c2-4d99-bea4-40e82fe3e47a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.672561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41273e60-d1c2-4d99-bea4-40e82fe3e47a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.672827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41273e60-d1c2-4d99-bea4-40e82fe3e47a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.672908] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41273e60-d1c2-4d99-bea4-40e82fe3e47a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.785149] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 828a3fee-5001-4141-bcfb-64c185ab0efa: rpc.has_security_group_logging(os_id): False [ 712.806991] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.807283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.807410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.807728] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.807728] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.807922] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.810022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.810022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.810022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.810022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.811502] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.811666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.811730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.812022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.812022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.812487] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.812634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.812816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.812816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.812919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.812967] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 712.890019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.890019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.890541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.890541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.890663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.912154] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 713.046469] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 in Status: SUCCESS [ 713.046642] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91426ce9-c57f-42ef-bcee-74c76f9876e0 deletion is rescheduled due to dependency. [ 713.046755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91426ce9-c57f-42ef-bcee-74c76f9876e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.175704] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41273e60-d1c2-4d99-bea4-40e82fe3e47a [ 713.175704] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.175704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.175704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.175935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.175935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.176091] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41273e60-d1c2-4d99-bea4-40e82fe3e47a already deleted. [ 713.176182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41273e60-d1c2-4d99-bea4-40e82fe3e47a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.394536] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.394739] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-935" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.394874] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-935" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.395223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-935" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.395489] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.395775] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.395895] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.397325] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.397602] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.397862] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.399427] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.399427] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.399427] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.399427] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.399601] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.400069] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.423744] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.423744] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.423744] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.423744] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-935" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.423744] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-13fa09d1-da09-4a01-bc28-c7fd25efb778 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.423744] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-13fa09d1-da09-4a01-bc28-c7fd25efb778" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.423744] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-13fa09d1-da09-4a01-bc28-c7fd25efb778" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.424509] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-13fa09d1-da09-4a01-bc28-c7fd25efb778" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.425841] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13fa09d1-da09-4a01-bc28-c7fd25efb778',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.929139] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.929550] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.929550] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.929785] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.930713] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.930943] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 13fa09d1-da09-4a01-bc28-c7fd25efb778 not found, creating... [ 713.931271] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.931440] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.931605] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.932079] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.932297] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.932832] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.932996] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.933125] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.933360] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.933496] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.933634] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 13fa09d1-da09-4a01-bc28-c7fd25efb778 is going to be created. [ 713.957305] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.957503] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.957623] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.957932] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.958152] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.958421] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-13fa09d1-da09-4a01-bc28-c7fd25efb778" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.371595] env[62909]: INFO networking_nsxv3.common.synchronization [req-7533229e-56ee-49e7-9ff2-0525b7e80b1d req-224bc663-da67-414c-bbbe-c262e5ae9ff2 tempest-ServersTestJSON-1417391248 tempest-ServersTestJSON-1417391248-project-member] Enqueued Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_members [ 714.371595] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_members [ 714.371595] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-2510be9a-503b-4668-a63b-e04e4a0997dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.371595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.375919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.375919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.375919] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.375919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.375919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.375919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.375919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.375919] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.860535] env[62909]: INFO networking_nsxv3.common.synchronization [None req-5693c673-91c7-4ef3-839b-d9b5e8d045a9 None None] Enqueued Resource ID: 6ae3c614-86f8-4fbf-8d22-12bcee065ee4 with Priority: HIGHEST for action port [ 714.861303] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae3c614-86f8-4fbf-8d22-12bcee065ee4 with Priority: HIGHEST for action port [ 714.861400] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ae3c614-86f8-4fbf-8d22-12bcee065ee4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.861489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ae3c614-86f8-4fbf-8d22-12bcee065ee4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.861536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ae3c614-86f8-4fbf-8d22-12bcee065ee4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.861813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ae3c614-86f8-4fbf-8d22-12bcee065ee4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.862243] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ae3c614-86f8-4fbf-8d22-12bcee065ee4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.875263] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.875424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.875487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.875946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.875946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.875946] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.876127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.876127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.876279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.876380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.876431] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2510be9a-503b-4668-a63b-e04e4a0997dc already deleted. [ 714.876506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.925253] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 714.925471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.099833] env[62909]: INFO networking_nsxv3.common.synchronization [req-bbaecb67-3608-42b4-9048-ef660eecc298 req-147d9fe7-0d61-46d5-be69-4564b6dcdbb2 service nova] Enqueued Resource ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb with Priority: HIGHEST for action security_group_rules [ 715.100141] env[62909]: INFO networking_nsxv3.common.synchronization [req-bbaecb67-3608-42b4-9048-ef660eecc298 req-147d9fe7-0d61-46d5-be69-4564b6dcdbb2 service nova] Enqueued Resource ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb with Priority: HIGHEST for action security_group_members [ 715.100293] env[62909]: INFO networking_nsxv3.common.synchronization [req-bbaecb67-3608-42b4-9048-ef660eecc298 req-147d9fe7-0d61-46d5-be69-4564b6dcdbb2 service nova] Enqueued Resource ID: 13fa09d1-da09-4a01-bc28-c7fd25efb778 with Priority: HIGHEST for action port [ 715.102193] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb with Priority: HIGHEST for action security_group_rules [ 715.102412] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb with Priority: HIGHEST for action security_group_members [ 715.102568] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13fa09d1-da09-4a01-bc28-c7fd25efb778 with Priority: HIGHEST for action port [ 715.103731] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.104266] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-221" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.104481] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-221" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.105019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-221" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.105368] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.105578] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.105976] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.106085] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.106280] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.107831] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.107831] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.107831] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.107831] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.107831] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.107831] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.107831] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.108997] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.109150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.109191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.109749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.109749] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe2d83f4-67d0-4b35-90a2-f919bc3f65bb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.110774] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.110908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.114116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.114116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.114116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.114116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.114116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.114116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.114116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.114116] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe2d83f4-67d0-4b35-90a2-f919bc3f65bb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.114116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-13fa09d1-da09-4a01-bc28-c7fd25efb778 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.114116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13fa09d1-da09-4a01-bc28-c7fd25efb778" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.114116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13fa09d1-da09-4a01-bc28-c7fd25efb778" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.114551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13fa09d1-da09-4a01-bc28-c7fd25efb778" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.114551] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13fa09d1-da09-4a01-bc28-c7fd25efb778',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.138022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.138022] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.138022] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.138022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-221" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.138022] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.138022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.138022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.138022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.138022] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.364451] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ae3c614-86f8-4fbf-8d22-12bcee065ee4 [ 715.364845] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.365705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.365904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.366205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.366330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.366472] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ae3c614-86f8-4fbf-8d22-12bcee065ee4 already deleted. [ 715.366555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ae3c614-86f8-4fbf-8d22-12bcee065ee4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.619069] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe2d83f4-67d0-4b35-90a2-f919bc3f65bb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.619069] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.619069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.619069] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13fa09d1-da09-4a01-bc28-c7fd25efb778 with status ACTIVE [ 715.619069] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.619069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.619069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.619069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.619069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.619835] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.619835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.619835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.619835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.619835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.619835] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.619835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.620065] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.620065] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.620228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.620363] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13fa09d1-da09-4a01-bc28-c7fd25efb778 is going to be updated. [ 715.640119] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.640371] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.640584] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.643017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.643017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.643017] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46 not found, creating... [ 715.643017] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.643017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.643017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.644646] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.644646] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.645110] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.645192] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.645407] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.645648] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.645804] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.645990] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46 is going to be created. [ 715.651151] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.651151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.651151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.651151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.651151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.651151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13fa09d1-da09-4a01-bc28-c7fd25efb778" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.672977] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.673175] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.673175] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.673455] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.673733] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.674692] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 715.916019] env[62909]: INFO networking_nsxv3.common.synchronization [None req-4b891516-8528-44f5-b600-ef1f5573892e None None] Enqueued Resource ID: dc0ecf14-3f38-4845-92e0-cb1be9f2e4a9 with Priority: HIGHEST for action port [ 715.916019] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc0ecf14-3f38-4845-92e0-cb1be9f2e4a9 with Priority: HIGHEST for action port [ 715.916019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc0ecf14-3f38-4845-92e0-cb1be9f2e4a9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.916019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc0ecf14-3f38-4845-92e0-cb1be9f2e4a9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 715.916019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc0ecf14-3f38-4845-92e0-cb1be9f2e4a9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.916019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc0ecf14-3f38-4845-92e0-cb1be9f2e4a9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 715.916019] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc0ecf14-3f38-4845-92e0-cb1be9f2e4a9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.125016] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe2d83f4-67d0-4b35-90a2-f919bc3f65bb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.419128] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc0ecf14-3f38-4845-92e0-cb1be9f2e4a9 [ 716.419128] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.419128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.419128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.419292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.419292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.421022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc0ecf14-3f38-4845-92e0-cb1be9f2e4a9 already deleted. [ 716.421022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc0ecf14-3f38-4845-92e0-cb1be9f2e4a9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.625575] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.629552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.629552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.629552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.629552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.629552] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb is going to be created. [ 716.654429] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.654627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.654705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.654961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.655248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.665545] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb in Status: UNINITIALIZED for 2s [ 717.105309] env[62909]: INFO networking_nsxv3.common.synchronization [req-7533229e-56ee-49e7-9ff2-0525b7e80b1d req-1e4d3774-8962-48c3-8670-a8c5e17e1b5a service nova] Enqueued Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_rules [ 717.105496] env[62909]: INFO networking_nsxv3.common.synchronization [req-7533229e-56ee-49e7-9ff2-0525b7e80b1d req-1e4d3774-8962-48c3-8670-a8c5e17e1b5a service nova] Enqueued Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_members [ 717.105708] env[62909]: INFO networking_nsxv3.common.synchronization [req-7533229e-56ee-49e7-9ff2-0525b7e80b1d req-1e4d3774-8962-48c3-8670-a8c5e17e1b5a service nova] Enqueued Resource ID: 8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46 with Priority: HIGHEST for action port [ 717.106265] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_rules [ 717.106408] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_members [ 717.106501] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46 with Priority: HIGHEST for action port [ 717.106775] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2510be9a-503b-4668-a63b-e04e4a0997dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.107256] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.107256] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.107256] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.107256] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.108179] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-2510be9a-503b-4668-a63b-e04e4a0997dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.108269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.108430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.108950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.109124] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.109356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.109356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.109448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.109537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.109629] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.110739] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.110847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.110913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.111086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.111163] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.131637] env[62909]: INFO networking_nsxv3.common.synchronization [req-38084650-faa8-4068-b8b7-78c70fda253b req-6e085d61-d164-4556-86e6-040a01d2a711 tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 717.132207] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 717.132642] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.132642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.132730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.132934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.133239] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.135044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.135044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.135044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.135044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.135044] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.618024] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.618024] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-2510be9a-503b-4668-a63b-e04e4a0997dc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.618024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.618024] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46 with status ACTIVE [ 717.618024] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.618024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.618024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.618024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.618024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.618024] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.618024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.618024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.618024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.618024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.618860] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.619667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.619858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.620133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.622582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.622582] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46 is going to be updated. [ 717.629026] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.629026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.629026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.629026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.629026] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.629026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.629026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.629891] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.633042] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.633042] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.633042] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.633042] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.633042] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.633042] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.633042] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.633042] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.635511] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.635829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.636116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.638019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.638019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.638019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.638019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.638019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.638019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.638019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.638019] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 717.649791] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.649791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.649791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.649791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.649791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.649791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eb60abb-6f7b-4b7e-b102-0d1d2fd78e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.662057] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.662057] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.662057] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.662057] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.662057] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-48f699bf-5203-47d2-88d5-9747169234ea taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.662057] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-48f699bf-5203-47d2-88d5-9747169234ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.662057] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-48f699bf-5203-47d2-88d5-9747169234ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.662057] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-48f699bf-5203-47d2-88d5-9747169234ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.662057] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f699bf-5203-47d2-88d5-9747169234ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.669028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.669028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.669028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.669028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.669028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.679461] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 718.123153] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.164786] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.165106] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.165332] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.165483] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.165633] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.165785] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 48f699bf-5203-47d2-88d5-9747169234ea not found, creating... [ 718.166066] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.166220] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.166420] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.166546] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.166681] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.166960] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.167250] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.167413] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.167669] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.167815] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.167993] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 48f699bf-5203-47d2-88d5-9747169234ea is going to be created. [ 718.190329] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.190572] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.190733] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.191095] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.191344] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.191788] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-48f699bf-5203-47d2-88d5-9747169234ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.366739] env[62909]: INFO networking_nsxv3.common.synchronization [None req-3eff5531-615c-4059-9d2d-cc7be2ca5f7d None None] Enqueued Resource ID: 24c3793d-640b-4015-9ac2-cc938378762c with Priority: HIGHEST for action port [ 718.367242] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c3793d-640b-4015-9ac2-cc938378762c with Priority: HIGHEST for action port [ 718.370490] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-24c3793d-640b-4015-9ac2-cc938378762c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.370619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24c3793d-640b-4015-9ac2-cc938378762c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.370619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24c3793d-640b-4015-9ac2-cc938378762c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.370980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24c3793d-640b-4015-9ac2-cc938378762c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.371192] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24c3793d-640b-4015-9ac2-cc938378762c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.626554] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.626722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.626760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.628044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.628044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.628044] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2510be9a-503b-4668-a63b-e04e4a0997dc is going to be created. [ 718.658153] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.658153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.658153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.658153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.658153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.671035] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2510be9a-503b-4668-a63b-e04e4a0997dc in Status: UNINITIALIZED for 2s [ 718.676025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb in Status: SUCCESS [ 718.676268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.676462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.679186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.679186] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.679186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.679186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.679186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.679186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.679186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.679186] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe2d83f4-67d0-4b35-90a2-f919bc3f65bb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.873553] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24c3793d-640b-4015-9ac2-cc938378762c [ 718.873853] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.873947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.873981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.874317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.874440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.874480] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24c3793d-640b-4015-9ac2-cc938378762c already deleted. [ 718.874546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24c3793d-640b-4015-9ac2-cc938378762c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 718.966952] env[62909]: INFO networking_nsxv3.common.synchronization [req-38084650-faa8-4068-b8b7-78c70fda253b req-96931720-3411-41d5-8b6a-582e398209f2 service nova] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_rules [ 718.967228] env[62909]: INFO networking_nsxv3.common.synchronization [req-38084650-faa8-4068-b8b7-78c70fda253b req-96931720-3411-41d5-8b6a-582e398209f2 service nova] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 718.967398] env[62909]: INFO networking_nsxv3.common.synchronization [req-38084650-faa8-4068-b8b7-78c70fda253b req-96931720-3411-41d5-8b6a-582e398209f2 service nova] Enqueued Resource ID: 48f699bf-5203-47d2-88d5-9747169234ea with Priority: HIGHEST for action port [ 718.972021] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_rules [ 718.972021] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 718.972021] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f699bf-5203-47d2-88d5-9747169234ea with Priority: HIGHEST for action port [ 718.972021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.972021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.972021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.972021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.972021] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.972021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.972021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.972021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-48f699bf-5203-47d2-88d5-9747169234ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.973179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48f699bf-5203-47d2-88d5-9747169234ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 718.973401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48f699bf-5203-47d2-88d5-9747169234ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.973897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48f699bf-5203-47d2-88d5-9747169234ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 718.974131] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f699bf-5203-47d2-88d5-9747169234ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.182156] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.182454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.182454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.184741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.185192] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.185192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.185192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.185570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.185570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.185570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.185673] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.185804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.185804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.185929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.186105] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.186240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.186338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.186488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.186564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.186645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.186735] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe2d83f4-67d0-4b35-90a2-f919bc3f65bb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.484798] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.484798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.484798] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48f699bf-5203-47d2-88d5-9747169234ea with status ACTIVE [ 719.484798] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.484798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.484798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.484798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.484798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.484798] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.484798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.484798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.484798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.484798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.484798] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.485378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.485378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.485378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.485378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.485378] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48f699bf-5203-47d2-88d5-9747169234ea is going to be updated. [ 719.508108] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.509444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.509444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.509444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.509444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.509444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48f699bf-5203-47d2-88d5-9747169234ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.691032] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe2d83f4-67d0-4b35-90a2-f919bc3f65bb: rpc.has_security_group_logging(os_id): False [ 719.696825] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 719.696976] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f deletion is rescheduled due to dependency. [ 719.697317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.697317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.698179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.698179] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.698179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.698179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.698356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.698388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.698535] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.717181] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.717317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.717387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.717735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.717735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.717945] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.718094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.718129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.718265] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.718336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.719050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.719050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.719050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.719050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.719050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.719582] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.719760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.719824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.719977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.720105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.720156] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb is going to be created. [ 719.833257] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.833400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.833472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.833696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.833877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.882249] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb in Status: IN_PROGRESS for 2s [ 720.207208] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.689500] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2510be9a-503b-4668-a63b-e04e4a0997dc in Status: SUCCESS [ 720.689801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.690098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.690373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.690744] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.690857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.690963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.691395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.691395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.691707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.691707] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.711690] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.791466] env[62909]: INFO networking_nsxv3.common.synchronization [req-93690a7c-7983-444f-9eca-053381ea7dad req-a6f81f80-4d26-41cf-bf21-d38507dfa772 tempest-ServerGroupTestJSON-730209564 tempest-ServerGroupTestJSON-730209564-project-member] Enqueued Resource ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 with Priority: HIGHEST for action security_group_members [ 720.791466] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 with Priority: HIGHEST for action security_group_members [ 720.791865] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599ba98-bf73-4cc1-922f-b14d6ba06469 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.792024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.792024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.792260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.792838] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.792936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.793009] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.793212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.793275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.793378] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f599ba98-bf73-4cc1-922f-b14d6ba06469',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.196626] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.216832] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.217246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.217246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.217246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.217407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.217885] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 721.248490] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.248665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.249040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.249040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.249123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.262568] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 721.299854] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.300134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.300272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.300649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.300810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.301125] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.301340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.301401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.301642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.301765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.301925] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 already deleted. [ 721.302071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.325080] env[62909]: INFO networking_nsxv3.common.synchronization [req-9557f973-d475-4bc2-a71e-1fa925bb05e4 req-0e79ff82-3eb9-4d69-b812-2984301d03a0 tempest-ServersAdminNegativeTestJSON-1035945787 tempest-ServersAdminNegativeTestJSON-1035945787-project-member] Enqueued Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 721.326450] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGHEST for action security_group_members [ 721.326450] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.326450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.326450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.326924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.326924] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.327043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.327081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.327405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.327405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.327506] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.370203] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.370423] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-729" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.370549] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-729" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.370855] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-729" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.372397] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.372397] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.372397] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.372397] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.372397] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.372397] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.372397] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.372397] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.372397] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.372397] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.372826] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.372826] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.392534] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.392534] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 721.392534] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.392534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-729" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.392534] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-6fb0a3a2-3560-49e6-85bc-32473f0b2985 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.392534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-6fb0a3a2-3560-49e6-85bc-32473f0b2985" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.392534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-6fb0a3a2-3560-49e6-85bc-32473f0b2985" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.392534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-6fb0a3a2-3560-49e6-85bc-32473f0b2985" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.392941] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb0a3a2-3560-49e6-85bc-32473f0b2985',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.702301] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2510be9a-503b-4668-a63b-e04e4a0997dc: rpc.has_security_group_logging(os_id): False [ 721.729095] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.729270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.729366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.729617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.729713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.729958] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.730086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.730152] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.730330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.730406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.730493] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2510be9a-503b-4668-a63b-e04e4a0997dc is going to be created. [ 721.797560] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.797791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.797791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.798387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.798387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.810547] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2510be9a-503b-4668-a63b-e04e4a0997dc in Status: IN_PROGRESS for 2s [ 721.835275] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.835469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.835506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.835708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.835803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.835997] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.836110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.836171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.836321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.836397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.836483] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d635d2b-1797-4206-b032-b7450c1074bc is going to be updated. [ 721.890470] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.890724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.890724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.890894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.891055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.894423] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb in Status: SUCCESS [ 721.894642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.896675] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.896866] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.896947] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.897254] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.897400] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.897549] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 6fb0a3a2-3560-49e6-85bc-32473f0b2985 not found, creating... [ 721.897819] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.898137] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.898137] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.898322] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.898454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.898741] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.899207] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.899207] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.899403] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.899566] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.899737] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 6fb0a3a2-3560-49e6-85bc-32473f0b2985 is going to be created. [ 721.901441] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: IN_PROGRESS for 2s [ 721.929021] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.929021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.929021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.929021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.929021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.929021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-6fb0a3a2-3560-49e6-85bc-32473f0b2985" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.714661] env[62909]: INFO networking_nsxv3.common.synchronization [req-9e9c3fd6-f02a-4790-a631-b8a9811bc51a req-d6114f47-d6c7-4d72-ab26-e9eb11f05678 tempest-ServerRescueTestJSON-1768795781 tempest-ServerRescueTestJSON-1768795781-project-member] Enqueued Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 722.717422] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 722.717843] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.718081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.718081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.718327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.718496] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.718606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.719028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.719028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.719028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.719197] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.133875] env[62909]: INFO networking_nsxv3.common.synchronization [req-93690a7c-7983-444f-9eca-053381ea7dad req-a612333b-bccf-48dc-9c7b-c702f83cc5cb service nova] Enqueued Resource ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 with Priority: HIGHEST for action security_group_rules [ 723.134109] env[62909]: INFO networking_nsxv3.common.synchronization [req-93690a7c-7983-444f-9eca-053381ea7dad req-a612333b-bccf-48dc-9c7b-c702f83cc5cb service nova] Enqueued Resource ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 with Priority: HIGHEST for action security_group_members [ 723.134295] env[62909]: INFO networking_nsxv3.common.synchronization [req-93690a7c-7983-444f-9eca-053381ea7dad req-a612333b-bccf-48dc-9c7b-c702f83cc5cb service nova] Enqueued Resource ID: 6fb0a3a2-3560-49e6-85bc-32473f0b2985 with Priority: HIGHEST for action port [ 723.135042] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 with Priority: HIGHEST for action security_group_rules [ 723.135042] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 with Priority: HIGHEST for action security_group_members [ 723.136910] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb0a3a2-3560-49e6-85bc-32473f0b2985 with Priority: HIGHEST for action port [ 723.137301] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f599ba98-bf73-4cc1-922f-b14d6ba06469 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.137433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.137501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.137828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.137876] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f599ba98-bf73-4cc1-922f-b14d6ba06469',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.141429] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599ba98-bf73-4cc1-922f-b14d6ba06469 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.141429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.144153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.144153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.144153] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.144153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.144153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.144153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.144153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.144153] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f599ba98-bf73-4cc1-922f-b14d6ba06469',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.146250] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fb0a3a2-3560-49e6-85bc-32473f0b2985 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.146400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fb0a3a2-3560-49e6-85bc-32473f0b2985" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.146400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fb0a3a2-3560-49e6-85bc-32473f0b2985" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.146516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fb0a3a2-3560-49e6-85bc-32473f0b2985" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.147016] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb0a3a2-3560-49e6-85bc-32473f0b2985',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.150186] env[62909]: INFO networking_nsxv3.common.synchronization [None req-d327f331-f6f2-4c99-bde0-9df4428fb748 None None] Enqueued Resource ID: 7060bc9e-cd93-423e-af13-ee82126bad27 with Priority: HIGHEST for action port [ 723.150934] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7060bc9e-cd93-423e-af13-ee82126bad27 with Priority: HIGHEST for action port [ 723.151254] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-7060bc9e-cd93-423e-af13-ee82126bad27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.151381] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7060bc9e-cd93-423e-af13-ee82126bad27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.151466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7060bc9e-cd93-423e-af13-ee82126bad27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.151709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7060bc9e-cd93-423e-af13-ee82126bad27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.151784] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7060bc9e-cd93-423e-af13-ee82126bad27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.222434] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.274099] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 723.274710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.276771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.276771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.276771] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.276771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.276771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.276771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.276771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.276771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.276771] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.351524] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.352356] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-811" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.352356] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-811" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.352702] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-811" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.353221] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.353542] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.353796] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.354192] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.354401] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.354848] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.354848] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.354970] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.355061] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.355232] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.355376] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.355558] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.377653] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.378480] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.378480] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.378480] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-811" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.378480] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-f2c2416f-fd5d-479b-b87b-5c00e77e23d0 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.378773] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-f2c2416f-fd5d-479b-b87b-5c00e77e23d0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.378773] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-f2c2416f-fd5d-479b-b87b-5c00e77e23d0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.379101] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-f2c2416f-fd5d-479b-b87b-5c00e77e23d0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.379424] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c2416f-fd5d-479b-b87b-5c00e77e23d0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.653257] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599ba98-bf73-4cc1-922f-b14d6ba06469 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.653388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.653585] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f599ba98-bf73-4cc1-922f-b14d6ba06469',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.654453] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fb0a3a2-3560-49e6-85bc-32473f0b2985 with status ACTIVE [ 723.656066] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.656066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.656066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.656066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.656066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.656066] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.656066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.656066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.656066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.656066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.656066] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.656066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.656066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.657320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.657563] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.657563] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fb0a3a2-3560-49e6-85bc-32473f0b2985 is going to be updated. [ 723.660164] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7060bc9e-cd93-423e-af13-ee82126bad27 [ 723.660164] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.661475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.661475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.661475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.661599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.661599] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7060bc9e-cd93-423e-af13-ee82126bad27 already deleted. [ 723.661673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7060bc9e-cd93-423e-af13-ee82126bad27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.685368] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.685368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.685368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.685368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.685575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.685832] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fb0a3a2-3560-49e6-85bc-32473f0b2985" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.729986] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.780523] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.781759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.781985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.782339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.785050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.785050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.785050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.785050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.785050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.785050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.785050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.788442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.788442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.788442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.788442] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.788442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.788442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.788442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.788442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.788442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.788442] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.826322] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2510be9a-503b-4668-a63b-e04e4a0997dc in Status: SUCCESS [ 723.826473] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.883872] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.884169] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.884307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.884646] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.884792] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.884943] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port f2c2416f-fd5d-479b-b87b-5c00e77e23d0 not found, creating... [ 723.885222] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.885371] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.886251] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.886251] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.886251] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.886251] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.886251] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.886505] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.886565] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.886694] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.886831] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: f2c2416f-fd5d-479b-b87b-5c00e77e23d0 is going to be created. [ 723.912525] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.912761] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.912884] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.913189] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.913424] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.913656] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-f2c2416f-fd5d-479b-b87b-5c00e77e23d0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.915125] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d635d2b-1797-4206-b032-b7450c1074bc in Status: SUCCESS [ 723.915284] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d635d2b-1797-4206-b032-b7450c1074bc deletion is rescheduled due to dependency. [ 723.915387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.161240] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f599ba98-bf73-4cc1-922f-b14d6ba06469',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.233627] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.233627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.233627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.233894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.233985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.234111] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d09a74b6-7c94-44f4-afba-b179607452eb is going to be updated. [ 724.271189] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.271189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.271189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.271367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.271463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.284191] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: IN_PROGRESS for 2s [ 724.293530] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f6e0db7-41ba-43f5-b841-2551ea96a39f: rpc.has_security_group_logging(os_id): False [ 724.312843] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.313199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.314403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.314403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.314403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.314403] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.314403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.314403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.314403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.314755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.314755] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.314884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.316267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.316267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.316267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.316267] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.316267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.316267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.316267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.316267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.316267] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 724.418648] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.418798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.418900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.419094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.419729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.435739] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 724.664246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.664246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.664481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.664596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.664765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.665034] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 is going to be created. [ 724.697056] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.697490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.697617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.697978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.698388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.720762] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 in Status: UNINITIALIZED for 2s [ 725.742168] env[62909]: INFO networking_nsxv3.common.synchronization [req-9e9c3fd6-f02a-4790-a631-b8a9811bc51a req-b7f59a32-cb24-4eef-bfcd-de95e6f5ee1a service nova] Enqueued Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_rules [ 725.742168] env[62909]: INFO networking_nsxv3.common.synchronization [req-9e9c3fd6-f02a-4790-a631-b8a9811bc51a req-b7f59a32-cb24-4eef-bfcd-de95e6f5ee1a service nova] Enqueued Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 725.742168] env[62909]: INFO networking_nsxv3.common.synchronization [req-9e9c3fd6-f02a-4790-a631-b8a9811bc51a req-b7f59a32-cb24-4eef-bfcd-de95e6f5ee1a service nova] Enqueued Resource ID: f2c2416f-fd5d-479b-b87b-5c00e77e23d0 with Priority: HIGHEST for action port [ 725.742168] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_rules [ 725.742168] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 725.742972] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2c2416f-fd5d-479b-b87b-5c00e77e23d0 with Priority: HIGHEST for action port [ 725.744811] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.744811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.744811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.745996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.745996] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.747160] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.747275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.748042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2c2416f-fd5d-479b-b87b-5c00e77e23d0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.748042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2c2416f-fd5d-479b-b87b-5c00e77e23d0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.748042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2c2416f-fd5d-479b-b87b-5c00e77e23d0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.748042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2c2416f-fd5d-479b-b87b-5c00e77e23d0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.748042] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c2416f-fd5d-479b-b87b-5c00e77e23d0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.255198] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2c2416f-fd5d-479b-b87b-5c00e77e23d0 with status ACTIVE [ 726.255198] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.255198] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.255198] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.255198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.255198] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2c2416f-fd5d-479b-b87b-5c00e77e23d0 is going to be updated. [ 726.258217] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.258217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.285409] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.285597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.285669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.289026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.289026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.289026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2c2416f-fd5d-479b-b87b-5c00e77e23d0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.304420] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: SUCCESS [ 726.304420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.304420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.304420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.304420] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.304420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.304420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.304420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.304420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.304898] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.452106] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 726.452347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.735766] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 in Status: SUCCESS [ 726.736047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.736278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.736528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.736728] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.736867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.736957] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.737202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.737290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.737404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.737551] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f599ba98-bf73-4cc1-922f-b14d6ba06469',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.808238] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.244011] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599ba98-bf73-4cc1-922f-b14d6ba06469 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.244240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.244295] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.244503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.244701] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.244820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.244883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.245061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.245154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.245242] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.245944] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599ba98-bf73-4cc1-922f-b14d6ba06469 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.245944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.245944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.245944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.245944] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.245944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.245944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.246289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.246289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.246289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.246289] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f599ba98-bf73-4cc1-922f-b14d6ba06469',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.250838] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e066c86b-0aef-4626-9686-44071f7cdd15 None None] Enqueued Resource ID: 44859978-0f08-47b9-9cdb-cbffc4149e10 with Priority: HIGHEST for action port [ 727.251177] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44859978-0f08-47b9-9cdb-cbffc4149e10 with Priority: HIGHEST for action port [ 727.251839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-44859978-0f08-47b9-9cdb-cbffc4149e10 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.252007] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44859978-0f08-47b9-9cdb-cbffc4149e10" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.252759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44859978-0f08-47b9-9cdb-cbffc4149e10" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.253301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44859978-0f08-47b9-9cdb-cbffc4149e10" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.253395] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44859978-0f08-47b9-9cdb-cbffc4149e10',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.311810] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.315274] env[62909]: INFO networking_nsxv3.common.synchronization [None req-be18440d-48c0-4c1e-8bc7-6ce617412e16 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_rules [ 727.315274] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_rules [ 727.315968] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70dd2e08-5d3c-47df-8c82-524cc320dde0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.316142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.316234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.316408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.316507] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.752394] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f599ba98-bf73-4cc1-922f-b14d6ba06469: rpc.has_security_group_logging(os_id): False [ 727.758445] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44859978-0f08-47b9-9cdb-cbffc4149e10 [ 727.758621] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.758776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.758837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.759314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.759314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.759314] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44859978-0f08-47b9-9cdb-cbffc4149e10 already deleted. [ 727.759314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44859978-0f08-47b9-9cdb-cbffc4149e10" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.773642] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.773837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.773837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.774060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.774155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.774338] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.774439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.774510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.774652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.774724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.774917] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.775012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.775078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.775225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.775296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.775484] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.775577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.775799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.775799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.775915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.775915] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 is going to be created. [ 727.791036] env[62909]: INFO networking_nsxv3.common.synchronization [req-b77847f6-e37d-4610-92c4-4e5b7bade7d5 req-79d90953-c148-4edc-8f15-9cdc897c0897 tempest-MigrationsAdminTest-16747298 tempest-MigrationsAdminTest-16747298-project-member] Enqueued Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 727.791036] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 727.791036] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.791036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.795251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.795507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.795731] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.795862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.795919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.796162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.796287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.796393] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.815395] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.815395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.815395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.815395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.815395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.815395] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d09a74b6-7c94-44f4-afba-b179607452eb is going to be updated. [ 727.855374] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.855374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.855374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.855374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.855374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.855374] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 already deleted. [ 727.855374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.866397] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.866558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.866627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.866994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.866994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.877062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.877161] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.877216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.877601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.877708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.881717] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: IN_PROGRESS for 2s [ 727.891503] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 in Status: IN_PROGRESS for 2s [ 728.127710] env[62909]: INFO networking_nsxv3.common.synchronization [None req-d9bf724f-5fa1-4d95-b4dc-a987fcce182c tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_rules [ 728.128345] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_rules [ 728.128704] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70dd2e08-5d3c-47df-8c82-524cc320dde0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.128858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.128954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.133139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.133238] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.300858] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.654851] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.655121] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.655292] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.656445] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.656857] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.657156] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.657649] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.657904] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.658082] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.658322] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.658501] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.658667] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.658813] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.659043] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.659479] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.659668] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.662511] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.662915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.663146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.663418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.663571] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.663688] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 already deleted. [ 728.663792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.689490] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.689490] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.689490] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.689490] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.689490] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-c148a862-a6a8-4c52-b1df-8e764ee00e94 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.689718] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-c148a862-a6a8-4c52-b1df-8e764ee00e94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.690083] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-c148a862-a6a8-4c52-b1df-8e764ee00e94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.690380] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-c148a862-a6a8-4c52-b1df-8e764ee00e94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.690601] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c148a862-a6a8-4c52-b1df-8e764ee00e94',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.807197] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.195080] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.195486] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.195486] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.195752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.195906] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.196073] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port c148a862-a6a8-4c52-b1df-8e764ee00e94 not found, creating... [ 729.196387] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.196524] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.197130] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.197130] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.197281] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.197662] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.197831] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.198531] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.198531] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.198531] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.198531] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: c148a862-a6a8-4c52-b1df-8e764ee00e94 is going to be created. [ 729.222543] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.224961] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.224961] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.224961] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.224961] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.224961] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-c148a862-a6a8-4c52-b1df-8e764ee00e94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.310230] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.310230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.310230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.310438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.310438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.312368] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b is going to be updated. [ 729.380337] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.381205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.381205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.381205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.381205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.398124] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: IN_PROGRESS for 2s [ 729.894683] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: SUCCESS [ 729.894913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.897151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.897487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.897779] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.898124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.898124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.898288] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.898387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.898514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.898669] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.913229] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 in Status: SUCCESS [ 729.913630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.402105] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.404323] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.404323] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.404323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.404323] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.407338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.407423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.407635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.407724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.407869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.407978] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.678141] env[62909]: INFO networking_nsxv3.common.synchronization [req-b77847f6-e37d-4610-92c4-4e5b7bade7d5 req-a86e824d-f9b4-4ad6-8b59-623c8e18a728 service nova] Enqueued Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_rules [ 730.678141] env[62909]: INFO networking_nsxv3.common.synchronization [req-b77847f6-e37d-4610-92c4-4e5b7bade7d5 req-a86e824d-f9b4-4ad6-8b59-623c8e18a728 service nova] Enqueued Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 730.678141] env[62909]: INFO networking_nsxv3.common.synchronization [req-b77847f6-e37d-4610-92c4-4e5b7bade7d5 req-a86e824d-f9b4-4ad6-8b59-623c8e18a728 service nova] Enqueued Resource ID: c148a862-a6a8-4c52-b1df-8e764ee00e94 with Priority: HIGHEST for action port [ 730.678141] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_rules [ 730.678141] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 730.678141] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c148a862-a6a8-4c52-b1df-8e764ee00e94 with Priority: HIGHEST for action port [ 730.678886] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.678886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.679056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.679159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.679239] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.680501] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.682014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.682014] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c148a862-a6a8-4c52-b1df-8e764ee00e94 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.682014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c148a862-a6a8-4c52-b1df-8e764ee00e94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.682014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c148a862-a6a8-4c52-b1df-8e764ee00e94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.682014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c148a862-a6a8-4c52-b1df-8e764ee00e94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.682014] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c148a862-a6a8-4c52-b1df-8e764ee00e94',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.912817] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d09a74b6-7c94-44f4-afba-b179607452eb: rpc.has_security_group_logging(os_id): False [ 730.932921] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.937082] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.937082] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.937082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.937721] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.937721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.937721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.937721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.937721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.938043] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d09a74b6-7c94-44f4-afba-b179607452eb is going to be updated. [ 731.021341] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.021341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.021341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.021341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.021341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.041558] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: IN_PROGRESS for 2s [ 731.184639] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.187868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.187868] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c148a862-a6a8-4c52-b1df-8e764ee00e94 with status ACTIVE [ 731.187868] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.187868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.187868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.187868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.187868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.187868] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.187868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.187868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.187868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.187868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.191216] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.191628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.191628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.191864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.192026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.192169] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c148a862-a6a8-4c52-b1df-8e764ee00e94 is going to be updated. [ 731.220814] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.221074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.221074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.221451] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.221556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.221737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c148a862-a6a8-4c52-b1df-8e764ee00e94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.411570] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: SUCCESS [ 731.411570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.412514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.412514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.412514] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.412514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.412514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.412859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.412859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.412962] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.917798] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.422416] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.527655] env[62909]: INFO networking_nsxv3.common.synchronization [req-220dddfd-b353-4591-afb4-d39639930b25 req-216494df-6322-4125-b344-2e85cfee81f8 tempest-ImagesNegativeTestJSON-924451865 tempest-ImagesNegativeTestJSON-924451865-project-member] Enqueued Resource ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb with Priority: HIGHEST for action security_group_members [ 732.528205] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb with Priority: HIGHEST for action security_group_members [ 732.528549] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.528993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.529074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.529338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.529623] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.530147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.530365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.530789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.530892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.531061] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe2d83f4-67d0-4b35-90a2-f919bc3f65bb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.932715] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.932914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.933170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.933372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.933466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.933575] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b is going to be updated. [ 732.978513] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.978707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.978766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.979042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.979203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.996368] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: IN_PROGRESS for 2s [ 733.034384] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.034586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.034684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.036962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.036962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.036962] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.036962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.036962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.036962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.036962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.036962] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb is going to be updated. [ 733.058402] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: SUCCESS [ 733.059385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.079947] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.080564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.080564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.080564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.083421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.094570] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb in Status: IN_PROGRESS for 2s [ 733.751988] env[62909]: INFO networking_nsxv3.common.synchronization [None req-5a165d5f-5fd5-491d-8a86-1f95c5cd4fb3 None None] Enqueued Resource ID: 057c91d4-8c23-4bdc-b691-27ca45ad0324 with Priority: HIGHEST for action port [ 733.751988] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 057c91d4-8c23-4bdc-b691-27ca45ad0324 with Priority: HIGHEST for action port [ 733.751988] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-057c91d4-8c23-4bdc-b691-27ca45ad0324 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.751988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-057c91d4-8c23-4bdc-b691-27ca45ad0324" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.751988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-057c91d4-8c23-4bdc-b691-27ca45ad0324" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.752627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-057c91d4-8c23-4bdc-b691-27ca45ad0324" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.752627] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('057c91d4-8c23-4bdc-b691-27ca45ad0324',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.917634] env[62909]: INFO networking_nsxv3.common.synchronization [None req-3b33f403-b0f6-4914-a87e-d943ef18a152 None None] Enqueued Resource ID: c572da37-3f7a-4c0a-8063-faac7cfdaff6 with Priority: HIGHEST for action port [ 733.917634] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c572da37-3f7a-4c0a-8063-faac7cfdaff6 with Priority: HIGHEST for action port [ 733.917634] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c572da37-3f7a-4c0a-8063-faac7cfdaff6 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.917793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c572da37-3f7a-4c0a-8063-faac7cfdaff6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.917825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c572da37-3f7a-4c0a-8063-faac7cfdaff6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.921021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c572da37-3f7a-4c0a-8063-faac7cfdaff6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.921021] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c572da37-3f7a-4c0a-8063-faac7cfdaff6',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.254479] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 057c91d4-8c23-4bdc-b691-27ca45ad0324 [ 734.254725] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.255052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.255187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.255608] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.255608] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.255812] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:057c91d4-8c23-4bdc-b691-27ca45ad0324 already deleted. [ 734.255994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-057c91d4-8c23-4bdc-b691-27ca45ad0324" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.424384] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c572da37-3f7a-4c0a-8063-faac7cfdaff6 [ 734.424384] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.424384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.424384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.424384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.424384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.424384] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c572da37-3f7a-4c0a-8063-faac7cfdaff6 already deleted. [ 734.424384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c572da37-3f7a-4c0a-8063-faac7cfdaff6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.012577] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: SUCCESS [ 735.013525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.013716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.013930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.014152] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.014272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.014341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.014499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.014576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.014696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.014801] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.106911] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb in Status: SUCCESS [ 735.106911] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb deletion is rescheduled due to dependency. [ 735.106911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.518781] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.519022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.519022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.519669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.519669] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.519669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.519669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.520492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.520492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.520492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.520492] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.520492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.520492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.520492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.520492] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.520770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.520770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.520829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.520859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.521684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.521684] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.024115] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24030e1e-897b-4a91-9a5a-7c9e92186e4b: rpc.has_security_group_logging(os_id): False [ 736.051934] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.052133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.052227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.052388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.052493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.052759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.052871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.052905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.053069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.053144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.053362] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.053453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.053522] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.053681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.053752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.053937] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.054225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.054304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.054512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.054571] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.054619] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b is going to be updated. [ 736.234751] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.234751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.234751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.234751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.234751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.260401] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: IN_PROGRESS for 2s [ 737.322057] env[62909]: INFO networking_nsxv3.common.synchronization [None req-df299694-f02b-49e5-ae02-1f491a95e69a None None] Enqueued Resource ID: e70953da-1469-4bf4-9b14-6e03d14d650b with Priority: HIGHEST for action port [ 737.322719] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70953da-1469-4bf4-9b14-6e03d14d650b with Priority: HIGHEST for action port [ 737.323169] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-e70953da-1469-4bf4-9b14-6e03d14d650b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.323411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e70953da-1469-4bf4-9b14-6e03d14d650b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.323547] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e70953da-1469-4bf4-9b14-6e03d14d650b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.323876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e70953da-1469-4bf4-9b14-6e03d14d650b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.324021] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e70953da-1469-4bf4-9b14-6e03d14d650b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.380064] env[62909]: INFO networking_nsxv3.common.synchronization [None req-48299ee8-d255-48cf-a14d-6e8bb13393b4 None None] Enqueued Resource ID: 5fd1e91c-b8f1-4647-88e8-d169bf788ae0 with Priority: HIGHEST for action port [ 737.380064] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd1e91c-b8f1-4647-88e8-d169bf788ae0 with Priority: HIGHEST for action port [ 737.380064] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fd1e91c-b8f1-4647-88e8-d169bf788ae0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.380064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fd1e91c-b8f1-4647-88e8-d169bf788ae0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.380064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fd1e91c-b8f1-4647-88e8-d169bf788ae0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.380064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fd1e91c-b8f1-4647-88e8-d169bf788ae0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.380064] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fd1e91c-b8f1-4647-88e8-d169bf788ae0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.828887] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e70953da-1469-4bf4-9b14-6e03d14d650b [ 737.828887] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.828887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.828887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.828887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.828887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.828887] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e70953da-1469-4bf4-9b14-6e03d14d650b already deleted. [ 737.828887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e70953da-1469-4bf4-9b14-6e03d14d650b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.883210] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fd1e91c-b8f1-4647-88e8-d169bf788ae0 [ 737.885038] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.885038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.885038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.885038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.885038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.885038] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fd1e91c-b8f1-4647-88e8-d169bf788ae0 already deleted. [ 737.885038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fd1e91c-b8f1-4647-88e8-d169bf788ae0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.277508] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: SUCCESS [ 738.277744] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.020930] env[62909]: INFO networking_nsxv3.common.synchronization [None req-635ebc91-55e6-4411-866d-3c1cc1e59480 None None] Enqueued Resource ID: a5a1428f-7545-408d-8569-54c9ca3d7788 with Priority: HIGHEST for action port [ 740.021214] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a1428f-7545-408d-8569-54c9ca3d7788 with Priority: HIGHEST for action port [ 740.021790] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5a1428f-7545-408d-8569-54c9ca3d7788 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.021959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5a1428f-7545-408d-8569-54c9ca3d7788" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.022037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5a1428f-7545-408d-8569-54c9ca3d7788" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.022330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5a1428f-7545-408d-8569-54c9ca3d7788" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.022428] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5a1428f-7545-408d-8569-54c9ca3d7788',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.524291] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5a1428f-7545-408d-8569-54c9ca3d7788 [ 740.524562] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.524769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.524874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.525104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.526212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.526626] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5a1428f-7545-408d-8569-54c9ca3d7788 already deleted. [ 740.526741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5a1428f-7545-408d-8569-54c9ca3d7788" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.718751] env[62909]: INFO networking_nsxv3.common.synchronization [None req-af451b0a-1853-47df-b0db-0143c659342a None None] Enqueued Resource ID: 404d5089-74c0-4578-9c12-25ab2f883830 with Priority: HIGHEST for action port [ 740.719604] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 404d5089-74c0-4578-9c12-25ab2f883830 with Priority: HIGHEST for action port [ 740.719604] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-404d5089-74c0-4578-9c12-25ab2f883830 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.721260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-404d5089-74c0-4578-9c12-25ab2f883830" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.721260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-404d5089-74c0-4578-9c12-25ab2f883830" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.721260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-404d5089-74c0-4578-9c12-25ab2f883830" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.721260] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('404d5089-74c0-4578-9c12-25ab2f883830',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.974975] env[62909]: INFO networking_nsxv3.common.synchronization [req-9ace44e5-87ac-445a-b169-f527629cc083 req-5ebc251d-4835-4200-bb2f-074c4c989ea2 tempest-ListServersNegativeTestJSON-838840043 tempest-ListServersNegativeTestJSON-838840043-project-member] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 740.975618] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 740.975939] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.978869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.978994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.982022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.982022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.982022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.982022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.982022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.982022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.982022] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.225011] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 404d5089-74c0-4578-9c12-25ab2f883830 [ 741.225292] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.225292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.225423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.225586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.225677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.225772] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:404d5089-74c0-4578-9c12-25ab2f883830 already deleted. [ 741.225856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-404d5089-74c0-4578-9c12-25ab2f883830" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.487086] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.783826] env[62909]: INFO networking_nsxv3.common.synchronization [req-de1b5fa7-be04-4d46-b709-1751e1df2421 req-fd8fcef2-4249-4260-be1a-70ed2dbd5c19 tempest-ListServersNegativeTestJSON-838840043 tempest-ListServersNegativeTestJSON-838840043-project-member] Enqueued Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 741.783826] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 with Priority: HIGHEST for action security_group_members [ 741.783826] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-037af277-a74d-482c-b3ec-c4b5f5f92980 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.783826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.918119] env[62909]: INFO networking_nsxv3.common.synchronization [req-c4224a8a-c76a-45c2-9466-cf9081bca12d req-f5325cb3-f651-4325-bc0a-a55012f46cf0 tempest-ServersTestMultiNic-523841259 tempest-ServersTestMultiNic-523841259-project-member] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 741.918566] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 741.918906] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.922072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.922072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.922511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.922511] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.922655] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.922699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.923441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.924039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.924157] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.991664] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.427384] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.427384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.427751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.430025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.430025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.430025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.430025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.430025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.430025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.430025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.430025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 742.462753] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.462753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.462753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.462753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.462753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.473200] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 742.500669] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.500669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.500669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.500669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.500669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.500669] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be updated. [ 742.530122] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.530122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.530122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.530355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.530387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.540065] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: IN_PROGRESS for 2s [ 742.875676] env[62909]: INFO networking_nsxv3.common.synchronization [req-c4224a8a-c76a-45c2-9466-cf9081bca12d req-01717416-f713-40d9-acf7-586baedba669 tempest-ServersTestMultiNic-523841259 tempest-ServersTestMultiNic-523841259-project-member] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 742.875676] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 742.875676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.876239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.363031] env[62909]: INFO networking_nsxv3.common.synchronization [None req-3d58bd5c-26c4-4111-959a-f8551ac8f63f None None] Enqueued Resource ID: 3a6102d9-0e62-4199-9788-3babc897100b with Priority: HIGHEST for action port [ 743.363031] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a6102d9-0e62-4199-9788-3babc897100b with Priority: HIGHEST for action port [ 743.363968] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a6102d9-0e62-4199-9788-3babc897100b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.363968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a6102d9-0e62-4199-9788-3babc897100b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.363968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a6102d9-0e62-4199-9788-3babc897100b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.364530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a6102d9-0e62-4199-9788-3babc897100b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.364530] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a6102d9-0e62-4199-9788-3babc897100b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.867045] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a6102d9-0e62-4199-9788-3babc897100b [ 743.867330] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.867408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.867477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.867758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.867890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.868011] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a6102d9-0e62-4199-9788-3babc897100b already deleted. [ 743.868085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a6102d9-0e62-4199-9788-3babc897100b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.871570] env[62909]: INFO networking_nsxv3.common.synchronization [None req-2b07a91a-4684-4109-81a5-be31af025a03 tempest-AttachVolumeShelveTestJSON-1170767985 tempest-AttachVolumeShelveTestJSON-1170767985-project-member] Enqueued Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_rules [ 743.871810] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_rules [ 743.872390] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.872516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.872585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.872819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.872897] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.173029] env[62909]: INFO networking_nsxv3.common.synchronization [req-48fe2c69-3f29-4ec6-8ada-1d74cc78d7fd req-a719b001-a298-4cc7-ac6f-026cfabd1940 tempest-ServerGroupTestJSON-730209564 tempest-ServerGroupTestJSON-730209564-project-member] Enqueued Resource ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 with Priority: HIGHEST for action security_group_members [ 744.173767] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 with Priority: HIGHEST for action security_group_members [ 744.176464] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599ba98-bf73-4cc1-922f-b14d6ba06469 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.176464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.176464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.176464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.176464] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.176464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.176464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.176464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.176464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.176464] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f599ba98-bf73-4cc1-922f-b14d6ba06469',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.266379] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-255 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.266649] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-255" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.266792] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-255" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.267208] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-255" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.267956] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.267956] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.267956] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.268215] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.268215] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.268423] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.268527] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.268681] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.268729] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.269167] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.269167] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.269167] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.302235] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.302235] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 744.302235] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.302235] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-255" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.303186] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-e8918472-71f8-4ab8-ae0e-d5333ff21e08 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.303186] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-e8918472-71f8-4ab8-ae0e-d5333ff21e08" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.303427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-e8918472-71f8-4ab8-ae0e-d5333ff21e08" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.304874] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-e8918472-71f8-4ab8-ae0e-d5333ff21e08" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.305067] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8918472-71f8-4ab8-ae0e-d5333ff21e08',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.394030] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.394198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.394501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.394557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.394669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.394782] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d711f143-3c86-4518-9590-301f0739c6ea already deleted. [ 744.394868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.486351] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 744.486351] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 deletion is rescheduled due to dependency. [ 744.486351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.486351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.486351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.486351] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.486351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.486351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.486351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.486351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.486351] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.554208] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 744.554887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.555481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.556141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.556548] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.556845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.557315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.557469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.557528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.557704] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037af277-a74d-482c-b3ec-c4b5f5f92980',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.679153] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.681127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.681127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.681127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.681127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.681127] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.681127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.681127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.681127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.681127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.681127] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 is going to be updated. [ 744.694389] env[62909]: INFO networking_nsxv3.common.synchronization [None req-18b8d1f1-aebb-4d9e-865b-4582a2b38ef6 None None] Enqueued Resource ID: 788eb8d6-2313-458b-8e5e-b4c76af78c03 with Priority: HIGHEST for action port [ 744.695051] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788eb8d6-2313-458b-8e5e-b4c76af78c03 with Priority: HIGHEST for action port [ 744.695638] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-788eb8d6-2313-458b-8e5e-b4c76af78c03 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.695771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-788eb8d6-2313-458b-8e5e-b4c76af78c03" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.695843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-788eb8d6-2313-458b-8e5e-b4c76af78c03" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.697029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-788eb8d6-2313-458b-8e5e-b4c76af78c03" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.697029] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('788eb8d6-2313-458b-8e5e-b4c76af78c03',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.715808] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.715808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.715808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.715986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.716857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.726535] env[62909]: INFO networking_nsxv3.common.synchronization [None req-52a3f7b7-4c12-4c9f-b24c-220033619a4c None None] Enqueued Resource ID: 27d620be-fe9d-4b29-8578-755d7d514ca3 with Priority: HIGHEST for action port [ 744.726535] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27d620be-fe9d-4b29-8578-755d7d514ca3 with Priority: HIGHEST for action port [ 744.726535] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-27d620be-fe9d-4b29-8578-755d7d514ca3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.726535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27d620be-fe9d-4b29-8578-755d7d514ca3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.726535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27d620be-fe9d-4b29-8578-755d7d514ca3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.726535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27d620be-fe9d-4b29-8578-755d7d514ca3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.726535] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27d620be-fe9d-4b29-8578-755d7d514ca3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.727850] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 in Status: IN_PROGRESS for 2s [ 744.802471] env[62909]: INFO networking_nsxv3.common.synchronization [None req-120f0a6c-f8dd-4dde-a1a4-6c75b5b8fdae tempest-AttachVolumeShelveTestJSON-1170767985 tempest-AttachVolumeShelveTestJSON-1170767985-project-member] Enqueued Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_rules [ 744.802951] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_rules [ 744.806559] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.806723] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.806795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.807033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.807114] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.812934] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.813183] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.813307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.813627] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.813797] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.813961] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port e8918472-71f8-4ab8-ae0e-d5333ff21e08 not found, creating... [ 744.814276] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.818022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.818022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.818022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.818022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.818022] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.818022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.818022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.818022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.818022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.818022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: e8918472-71f8-4ab8-ae0e-d5333ff21e08 is going to be created. [ 744.848404] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.848404] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.848404] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.848404] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.848404] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.848404] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-e8918472-71f8-4ab8-ae0e-d5333ff21e08" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.949031] env[62909]: INFO networking_nsxv3.common.synchronization [req-b92f8850-271a-4e10-9ba4-3dc55acb5936 req-ea23c742-2c81-47a3-ac26-0490705eb5b4 tempest-ServersV294TestFqdnHostnames-1806071593 tempest-ServersV294TestFqdnHostnames-1806071593-project-member] Enqueued Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_members [ 744.949031] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_members [ 744.949031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d35f16-322f-4fce-8671-2c59aba9257f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.949031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.949031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.949031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.949031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.949031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.949936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.949936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.949936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.949936] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d35f16-322f-4fce-8671-2c59aba9257f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.989623] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.990068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.990200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.990858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.994144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.994144] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.994439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.994439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.994657] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.994767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.994882] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 745.030597] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.030779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.030779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.031645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.031645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.040987] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 745.062601] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.062777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.062817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.063042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.063142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.063341] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.063441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.063500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.063652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.063728] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.063814] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 is going to be updated. [ 745.113601] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.113601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.113601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.114086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.114086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.123205] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: IN_PROGRESS for 2s [ 745.200546] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 788eb8d6-2313-458b-8e5e-b4c76af78c03 [ 745.200847] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.201071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.201157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.201374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.201466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.201565] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:788eb8d6-2313-458b-8e5e-b4c76af78c03 already deleted. [ 745.201653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-788eb8d6-2313-458b-8e5e-b4c76af78c03" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.229231] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27d620be-fe9d-4b29-8578-755d7d514ca3 [ 745.229449] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.229778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.229778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.231102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.231102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.231102] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27d620be-fe9d-4b29-8578-755d7d514ca3 already deleted. [ 745.231102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27d620be-fe9d-4b29-8578-755d7d514ca3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.334947] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.335319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.335460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.336325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.336643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.336821] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d711f143-3c86-4518-9590-301f0739c6ea already deleted. [ 745.336969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.452506] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.452685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.452770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.452946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.453053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.453254] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.453352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.453709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.453709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.453709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.453901] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d35f16-322f-4fce-8671-2c59aba9257f already deleted. [ 745.453901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.676167] env[62909]: INFO networking_nsxv3.common.synchronization [req-3917d2a9-bc74-4a28-a611-872fdc809f3e req-a016187f-1141-4833-9c43-ad07ebc8ff7b tempest-ServersWithSpecificFlavorTestJSON-184799251 tempest-ServersWithSpecificFlavorTestJSON-184799251-project-member] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 745.677704] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGHEST for action security_group_members [ 745.681224] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.681224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.681224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.681224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.681504] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.681504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.681504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.681610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.681652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.682364] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.156888] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-115 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.157244] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-115" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.157244] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-115" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.157573] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-115" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.157838] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.157996] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.159230] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.159230] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.159230] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.159230] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.159230] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.159230] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.163453] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.163546] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.163671] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.163811] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.185529] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.185922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.185922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.186063] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.187254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.187254] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.187254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.187254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.187254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.187254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.187254] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 is going to be updated. [ 746.188833] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.189042] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.189222] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.189416] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-115" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.189811] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-29704154-556c-4ee1-a5d2-fafcd0ac6017 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.190136] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-29704154-556c-4ee1-a5d2-fafcd0ac6017" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.190203] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-29704154-556c-4ee1-a5d2-fafcd0ac6017" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.190502] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-29704154-556c-4ee1-a5d2-fafcd0ac6017" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.190689] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29704154-556c-4ee1-a5d2-fafcd0ac6017',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.220911] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.220911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.220911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.220911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.220911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.244455] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: IN_PROGRESS for 2s [ 746.693654] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.694029] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.694109] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.694796] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.694796] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.694910] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 29704154-556c-4ee1-a5d2-fafcd0ac6017 not found, creating... [ 746.695192] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.695398] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.695525] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.695787] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.695939] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.698058] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.698058] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.698058] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.698058] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.698058] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.698058] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 29704154-556c-4ee1-a5d2-fafcd0ac6017 is going to be created. [ 746.718940] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.718940] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.718940] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.719210] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.719361] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.719546] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-29704154-556c-4ee1-a5d2-fafcd0ac6017" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.742362] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 in Status: SUCCESS [ 746.742362] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 deletion is rescheduled due to dependency. [ 746.742499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.998692] env[62909]: INFO networking_nsxv3.common.synchronization [req-5239dcd0-c558-43cc-8209-d1eb7a2f5675 req-0ebecabe-d7e8-460d-bb97-cd80ea242d38 tempest-ImagesTestJSON-652168268 tempest-ImagesTestJSON-652168268-project-member] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 747.000905] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 747.001034] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.001229] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.001300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.001551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.001664] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.001773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.001835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.002238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.002238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.002238] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.050845] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 747.052098] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 deletion is rescheduled due to dependency. [ 747.052209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.136716] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 in Status: SUCCESS [ 747.136716] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037af277-a74d-482c-b3ec-c4b5f5f92980 deletion is rescheduled due to dependency. [ 747.136716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037af277-a74d-482c-b3ec-c4b5f5f92980" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.142076] env[62909]: INFO networking_nsxv3.common.synchronization [req-c4224a8a-c76a-45c2-9466-cf9081bca12d req-55ff405f-0b4c-4c70-86c2-dd3f1220b674 service nova] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_rules [ 747.142076] env[62909]: INFO networking_nsxv3.common.synchronization [req-c4224a8a-c76a-45c2-9466-cf9081bca12d req-55ff405f-0b4c-4c70-86c2-dd3f1220b674 service nova] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 747.142076] env[62909]: INFO networking_nsxv3.common.synchronization [req-c4224a8a-c76a-45c2-9466-cf9081bca12d req-55ff405f-0b4c-4c70-86c2-dd3f1220b674 service nova] Enqueued Resource ID: e8918472-71f8-4ab8-ae0e-d5333ff21e08 with Priority: HIGHEST for action port [ 747.142837] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_rules [ 747.143195] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 747.143559] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8918472-71f8-4ab8-ae0e-d5333ff21e08 with Priority: HIGHEST for action port [ 747.144198] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.144390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.144483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.144912] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.144991] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.145950] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.145950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.146067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.146200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.146366] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.146462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.146523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.146819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.146819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.146916] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.147677] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8918472-71f8-4ab8-ae0e-d5333ff21e08 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.147773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8918472-71f8-4ab8-ae0e-d5333ff21e08" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.147830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8918472-71f8-4ab8-ae0e-d5333ff21e08" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.147980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8918472-71f8-4ab8-ae0e-d5333ff21e08" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.150718] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8918472-71f8-4ab8-ae0e-d5333ff21e08',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.303856] env[62909]: INFO networking_nsxv3.common.synchronization [req-651dc365-09e0-4e53-8437-5b4e70750a20 req-2640d4b6-378c-4992-a13e-ad9a3ae06c9e tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 747.304585] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 747.304987] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.305183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.305636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.305832] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.307087] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.307252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.307369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.307604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.307729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.307872] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.504858] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.505836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.505836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.505836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.505836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.505836] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.505836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.505836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.506269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.506269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.506269] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 747.546633] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.549318] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.549604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.550082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.550082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.561733] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 747.661374] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.661374] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.661374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.661374] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8918472-71f8-4ab8-ae0e-d5333ff21e08 with status ACTIVE [ 747.661374] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.661374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.661374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.661374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.664630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.664630] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.664630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.664630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.664630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.664630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.664630] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.664630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.664630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.664630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.664630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.664630] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8918472-71f8-4ab8-ae0e-d5333ff21e08 is going to be updated. [ 747.698030] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.698030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.698030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.698030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.698030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.698030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8918472-71f8-4ab8-ae0e-d5333ff21e08" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.704676] env[62909]: INFO networking_nsxv3.common.synchronization [req-b92f8850-271a-4e10-9ba4-3dc55acb5936 req-6320ab77-cd3c-41f4-a5c3-d5ba4973f619 service nova] Enqueued Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_rules [ 747.705285] env[62909]: INFO networking_nsxv3.common.synchronization [req-b92f8850-271a-4e10-9ba4-3dc55acb5936 req-6320ab77-cd3c-41f4-a5c3-d5ba4973f619 service nova] Enqueued Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_members [ 747.705285] env[62909]: INFO networking_nsxv3.common.synchronization [req-b92f8850-271a-4e10-9ba4-3dc55acb5936 req-6320ab77-cd3c-41f4-a5c3-d5ba4973f619 service nova] Enqueued Resource ID: 29704154-556c-4ee1-a5d2-fafcd0ac6017 with Priority: HIGHEST for action port [ 747.706507] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_rules [ 747.706507] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_members [ 747.706507] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29704154-556c-4ee1-a5d2-fafcd0ac6017 with Priority: HIGHEST for action port [ 747.708790] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d35f16-322f-4fce-8671-2c59aba9257f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.708790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.708790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.708790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.708790] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d35f16-322f-4fce-8671-2c59aba9257f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.709941] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d35f16-322f-4fce-8671-2c59aba9257f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.711963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.712166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.712435] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.713573] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.713573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.713573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.713842] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.714063] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.714170] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d35f16-322f-4fce-8671-2c59aba9257f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.716401] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-29704154-556c-4ee1-a5d2-fafcd0ac6017 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.716756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29704154-556c-4ee1-a5d2-fafcd0ac6017" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.716756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29704154-556c-4ee1-a5d2-fafcd0ac6017" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.717698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29704154-556c-4ee1-a5d2-fafcd0ac6017" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.717698] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29704154-556c-4ee1-a5d2-fafcd0ac6017',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.811127] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.811127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.811127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.811392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.811392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.811517] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.811609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.811811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.811811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.811993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.811993] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 already deleted. [ 747.812182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.168163] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.219377] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d35f16-322f-4fce-8671-2c59aba9257f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.220653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.220653] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85d35f16-322f-4fce-8671-2c59aba9257f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.223025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29704154-556c-4ee1-a5d2-fafcd0ac6017 with status ACTIVE [ 748.223025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.223025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.223025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.223025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.223025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.223025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.223025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.223025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.227037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.227037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.227037] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.227037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.227037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.227037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.227037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.227512] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29704154-556c-4ee1-a5d2-fafcd0ac6017 is going to be updated. [ 748.256877] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 in Status: SUCCESS [ 748.257106] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 deletion is rescheduled due to dependency. [ 748.257232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.258307] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.258443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.258502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.258745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.258915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.260274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29704154-556c-4ee1-a5d2-fafcd0ac6017" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.466222] env[62909]: INFO networking_nsxv3.common.synchronization [None req-2d509511-cfe8-4503-b73c-f9157cc7bc3a None None] Enqueued Resource ID: 6ac573be-119d-473d-a390-d3e79c1a8acd with Priority: HIGHEST for action port [ 748.467030] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac573be-119d-473d-a390-d3e79c1a8acd with Priority: HIGHEST for action port [ 748.467689] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ac573be-119d-473d-a390-d3e79c1a8acd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.467943] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ac573be-119d-473d-a390-d3e79c1a8acd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.467943] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ac573be-119d-473d-a390-d3e79c1a8acd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.468224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ac573be-119d-473d-a390-d3e79c1a8acd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.468282] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ac573be-119d-473d-a390-d3e79c1a8acd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.592472] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.593351] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-557" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.593351] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-557" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.595079] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-557" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.595537] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.595777] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.596009] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.596907] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.597755] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.598084] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.598653] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.598653] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.598653] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.598782] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.599077] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.599077] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.624643] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.625068] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 748.625068] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.625224] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-557" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.625498] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-c68776d2-73ad-4ec2-b114-31f5878098d8 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.625673] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.625790] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.626129] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.626280] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c68776d2-73ad-4ec2-b114-31f5878098d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.671235] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.671391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.671602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.671690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.671857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.671922] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 748.702298] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.702438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.702502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.702903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.703360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.716716] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 748.730977] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85d35f16-322f-4fce-8671-2c59aba9257f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.973058] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ac573be-119d-473d-a390-d3e79c1a8acd [ 748.973312] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.973454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.973513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.973745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.973828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.974044] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ac573be-119d-473d-a390-d3e79c1a8acd already deleted. [ 748.974044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ac573be-119d-473d-a390-d3e79c1a8acd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.045620] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-157 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.047597] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-157" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.047806] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-157" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.048272] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-157" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.048474] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.048640] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.048756] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.049398] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.049695] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.050127] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.050127] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.050475] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.050608] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.050796] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.050913] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.051331] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.072504] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.074358] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.074358] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.074358] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-157" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.074358] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-04bf9072-5af6-410e-bc35-bcd17631d744 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.074358] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-04bf9072-5af6-410e-bc35-bcd17631d744" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.074358] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-04bf9072-5af6-410e-bc35-bcd17631d744" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.074358] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-04bf9072-5af6-410e-bc35-bcd17631d744" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.074358] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04bf9072-5af6-410e-bc35-bcd17631d744',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.130043] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.130043] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.130043] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.133950] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.133950] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.133950] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port c68776d2-73ad-4ec2-b114-31f5878098d8 not found, creating... [ 749.133950] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.133950] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.133950] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.133950] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.143025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.143025] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.143025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.143025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.143025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.143025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.143025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: c68776d2-73ad-4ec2-b114-31f5878098d8 is going to be created. [ 749.169523] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.170486] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.170486] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.171401] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.171401] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.171401] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.237420] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.237420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.237420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.237420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.237420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.237420] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d35f16-322f-4fce-8671-2c59aba9257f is going to be created. [ 749.274870] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.274870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.274870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.275167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.275234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.307062] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d35f16-322f-4fce-8671-2c59aba9257f in Status: UNINITIALIZED for 2s [ 749.573189] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 749.573542] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa deletion is rescheduled due to dependency. [ 749.573542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.578237] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.578452] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.578594] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.578901] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.579081] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.579236] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 04bf9072-5af6-410e-bc35-bcd17631d744 not found, creating... [ 749.579602] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.579770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.579859] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.580098] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.580235] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.580561] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.580693] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.581248] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.581515] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.581734] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.581912] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 04bf9072-5af6-410e-bc35-bcd17631d744 is going to be created. [ 749.604264] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.604475] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.604599] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.604893] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.605107] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.605343] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-04bf9072-5af6-410e-bc35-bcd17631d744" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.154861] env[62909]: INFO networking_nsxv3.common.synchronization [None req-70b11f76-3580-4814-bdb4-5bb75b521ab1 None None] Enqueued Resource ID: fe754215-4326-4e79-a7fa-4fd83789f469 with Priority: HIGHEST for action port [ 750.154861] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe754215-4326-4e79-a7fa-4fd83789f469 with Priority: HIGHEST for action port [ 750.154861] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe754215-4326-4e79-a7fa-4fd83789f469 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.154861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe754215-4326-4e79-a7fa-4fd83789f469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.154861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe754215-4326-4e79-a7fa-4fd83789f469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.154861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe754215-4326-4e79-a7fa-4fd83789f469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.154861] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe754215-4326-4e79-a7fa-4fd83789f469',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.658583] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe754215-4326-4e79-a7fa-4fd83789f469 [ 750.658873] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.659372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.659372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.659372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.659485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.659976] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe754215-4326-4e79-a7fa-4fd83789f469 already deleted. [ 750.659976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe754215-4326-4e79-a7fa-4fd83789f469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.697552] env[62909]: INFO networking_nsxv3.common.synchronization [req-651dc365-09e0-4e53-8437-5b4e70750a20 req-c663e588-86c0-4493-b7c3-4e4a3a87fa8f service nova] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 750.697736] env[62909]: INFO networking_nsxv3.common.synchronization [req-651dc365-09e0-4e53-8437-5b4e70750a20 req-c663e588-86c0-4493-b7c3-4e4a3a87fa8f service nova] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 750.697926] env[62909]: INFO networking_nsxv3.common.synchronization [req-651dc365-09e0-4e53-8437-5b4e70750a20 req-c663e588-86c0-4493-b7c3-4e4a3a87fa8f service nova] Enqueued Resource ID: c68776d2-73ad-4ec2-b114-31f5878098d8 with Priority: HIGHEST for action port [ 750.700164] env[62909]: INFO networking_nsxv3.common.synchronization [None req-09eea408-6c1d-48a2-9da9-04a703e737e2 None None] Enqueued Resource ID: 9160b7e7-44b8-4ee2-a414-6e626cd62ba7 with Priority: HIGHEST for action port [ 750.700164] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 750.700164] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c68776d2-73ad-4ec2-b114-31f5878098d8 with Priority: HIGHEST for action port [ 750.700164] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 750.700164] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9160b7e7-44b8-4ee2-a414-6e626cd62ba7 with Priority: HIGHEST for action port [ 750.700164] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.700164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.700164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.700603] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.700908] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.702104] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c68776d2-73ad-4ec2-b114-31f5878098d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.702275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.702383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.702611] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.702761] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c68776d2-73ad-4ec2-b114-31f5878098d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.703678] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.704018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.704018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.704300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.704372] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.704522] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.704622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.704823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.705029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.705329] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.706233] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-9160b7e7-44b8-4ee2-a414-6e626cd62ba7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.709437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9160b7e7-44b8-4ee2-a414-6e626cd62ba7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.709437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9160b7e7-44b8-4ee2-a414-6e626cd62ba7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.709437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9160b7e7-44b8-4ee2-a414-6e626cd62ba7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.709437] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9160b7e7-44b8-4ee2-a414-6e626cd62ba7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.731758] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 750.731871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.732024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.732525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.732525] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.732525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.732769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.732769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.732826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.732931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.734690] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.210869] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.211191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.211493] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c68776d2-73ad-4ec2-b114-31f5878098d8 with status ACTIVE [ 751.211862] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.212106] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.212262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.212566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.212812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.214224] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.214224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.214224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.214224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.214494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.214494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.214628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.214628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.214892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.214892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.214997] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c68776d2-73ad-4ec2-b114-31f5878098d8 is going to be updated. [ 751.220223] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.231744] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9160b7e7-44b8-4ee2-a414-6e626cd62ba7 [ 751.233033] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.233155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.233155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.233346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.233437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.233540] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9160b7e7-44b8-4ee2-a414-6e626cd62ba7 already deleted. [ 751.233623] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9160b7e7-44b8-4ee2-a414-6e626cd62ba7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.237228] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.237367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.237436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.237657] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.237826] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.237926] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.237988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.238255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.238346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.239031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.239031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.239031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.239031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.239031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.239031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.240677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.240677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.240677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.240677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.240677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.240677] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.246021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.246021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.246021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.246021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.246021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.248093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.261475] env[62909]: INFO networking_nsxv3.common.synchronization [req-c4224a8a-c76a-45c2-9466-cf9081bca12d req-b69e934b-7563-4569-a4d2-7d6becf87e35 service nova] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_rules [ 751.261475] env[62909]: INFO networking_nsxv3.common.synchronization [req-c4224a8a-c76a-45c2-9466-cf9081bca12d req-b69e934b-7563-4569-a4d2-7d6becf87e35 service nova] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 751.261475] env[62909]: INFO networking_nsxv3.common.synchronization [req-c4224a8a-c76a-45c2-9466-cf9081bca12d req-b69e934b-7563-4569-a4d2-7d6becf87e35 service nova] Enqueued Resource ID: 04bf9072-5af6-410e-bc35-bcd17631d744 with Priority: HIGHEST for action port [ 751.265146] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_rules [ 751.265146] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 751.265146] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04bf9072-5af6-410e-bc35-bcd17631d744 with Priority: HIGHEST for action port [ 751.265146] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.265146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.265146] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.265146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.265146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.265146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.265146] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.265146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.265146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.265146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.265146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.265146] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.267778] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-04bf9072-5af6-410e-bc35-bcd17631d744 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.267930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04bf9072-5af6-410e-bc35-bcd17631d744" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.268059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04bf9072-5af6-410e-bc35-bcd17631d744" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.268325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04bf9072-5af6-410e-bc35-bcd17631d744" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.268434] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04bf9072-5af6-410e-bc35-bcd17631d744',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.331628] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d35f16-322f-4fce-8671-2c59aba9257f in Status: SUCCESS [ 751.331948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.332199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.332481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.332759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.332922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.333021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.333247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.333363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.333479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.333599] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85d35f16-322f-4fce-8671-2c59aba9257f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.721055] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.744359] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae9364a2-033c-455a-b65c-755fec76be27: rpc.has_security_group_logging(os_id): False [ 751.763028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.763221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.763297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.765641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.765750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.765965] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.766110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.766173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.766342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.766424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.766643] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.766742] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.766806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.766944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.767028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.767208] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.767296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.767356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.767499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.767590] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.767685] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 751.770401] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.771328] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04bf9072-5af6-410e-bc35-bcd17631d744 with status ACTIVE [ 751.771483] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.771599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.771660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.771829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.771910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.772091] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.772182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.772242] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.772387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.772461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.772637] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.772791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.772791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.772911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.772982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.773078] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04bf9072-5af6-410e-bc35-bcd17631d744 is going to be updated. [ 751.803209] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.803358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.803425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.803670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.803928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.803984] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04bf9072-5af6-410e-bc35-bcd17631d744" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.841547] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85d35f16-322f-4fce-8671-2c59aba9257f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.864501] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.868247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.868247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.868247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.868247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.893322] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 751.956237] env[62909]: INFO networking_nsxv3.common.synchronization [req-9df777fc-cdd3-4011-8d64-b901bbb4b81c req-57e7cef0-2499-487a-a4c3-d1e26cbce3b7 tempest-FloatingIPsAssociationTestJSON-150665211 tempest-FloatingIPsAssociationTestJSON-150665211-project-member] Enqueued Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 751.956237] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 751.959540] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.965805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.965805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.965805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.965805] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.965805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.965805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.965805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.965805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.965805] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.224717] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.224814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.224856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.225057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.225141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.225237] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be created. [ 752.268359] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.268491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.268631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.268779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.268938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.278870] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.282746] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: UNINITIALIZED for 2s [ 752.345985] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85d35f16-322f-4fce-8671-2c59aba9257f: rpc.has_security_group_logging(os_id): False [ 752.369405] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.370975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.370975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.370975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.370975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.370975] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.370975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.370975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.370975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.370975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.370975] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d35f16-322f-4fce-8671-2c59aba9257f is going to be created. [ 752.453695] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.453695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.453695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.453695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.453695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.469024] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85d35f16-322f-4fce-8671-2c59aba9257f in Status: IN_PROGRESS for 2s [ 752.469024] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.469024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.469024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.470319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.470966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.471345] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.471610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.471778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.472132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.472272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.472483] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e already deleted. [ 752.472665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.782525] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.783788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.783788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.783788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.783788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.783788] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 752.825293] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.825293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.825293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.825293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.825293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.836712] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 753.085868] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b699c331-323c-4703-8d01-44a2b08561e7 None None] Enqueued Resource ID: cad403ad-a1ac-4517-80e3-356d80e3113c with Priority: HIGHEST for action port [ 753.085868] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad403ad-a1ac-4517-80e3-356d80e3113c with Priority: HIGHEST for action port [ 753.085868] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-cad403ad-a1ac-4517-80e3-356d80e3113c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.085868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cad403ad-a1ac-4517-80e3-356d80e3113c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.085868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cad403ad-a1ac-4517-80e3-356d80e3113c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.085868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cad403ad-a1ac-4517-80e3-356d80e3113c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.085868] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cad403ad-a1ac-4517-80e3-356d80e3113c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.297699] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-614 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.297699] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-614" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.297699] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-614" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.299184] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-614" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.299184] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.299184] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.299184] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.299184] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.299184] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.299464] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.299464] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.299464] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.299577] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.299692] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.299799] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.299929] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.301843] env[62909]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] NSXv3 Agent Agent loop - iteration:0 completed [ 753.301963] env[62909]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] NSXv3 Agent Agent loop - iteration:1 started [ 753.338552] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.338552] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 753.339878] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.339878] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-614" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.339878] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-691c01fe-1d59-431c-9474-7726ec537a5b taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.339878] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-691c01fe-1d59-431c-9474-7726ec537a5b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.339878] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-691c01fe-1d59-431c-9474-7726ec537a5b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.345022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-691c01fe-1d59-431c-9474-7726ec537a5b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.345022] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('691c01fe-1d59-431c-9474-7726ec537a5b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.590512] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cad403ad-a1ac-4517-80e3-356d80e3113c [ 753.590968] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.591770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.591770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.592211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.592471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.592471] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cad403ad-a1ac-4517-80e3-356d80e3113c already deleted. [ 753.592574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cad403ad-a1ac-4517-80e3-356d80e3113c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.847718] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.847718] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.848240] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.848240] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.848240] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.848432] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 691c01fe-1d59-431c-9474-7726ec537a5b not found, creating... [ 753.850124] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.851551] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.851551] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.851551] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.851551] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.851551] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.851551] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.851551] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.851800] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.852473] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.852473] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 691c01fe-1d59-431c-9474-7726ec537a5b is going to be created. [ 753.877091] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.878865] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.878865] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.878865] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.878989] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.880690] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-691c01fe-1d59-431c-9474-7726ec537a5b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.891384] env[62909]: INFO networking_nsxv3.common.synchronization [None req-6b93175c-b2e0-40a6-950a-2397139f242e None None] Enqueued Resource ID: eb1c7cd9-1636-426d-9d20-c863f0d9e7a2 with Priority: HIGHEST for action port [ 753.891564] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb1c7cd9-1636-426d-9d20-c863f0d9e7a2 with Priority: HIGHEST for action port [ 753.892153] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb1c7cd9-1636-426d-9d20-c863f0d9e7a2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.894118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb1c7cd9-1636-426d-9d20-c863f0d9e7a2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.894118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb1c7cd9-1636-426d-9d20-c863f0d9e7a2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.894118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb1c7cd9-1636-426d-9d20-c863f0d9e7a2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.894118] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb1c7cd9-1636-426d-9d20-c863f0d9e7a2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.908229] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 753.908457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.908928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.909164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.909922] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.294463] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 754.295091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.295300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.295525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.297083] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.297083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.297083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.297083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.297083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.297083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.297083] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.398047] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb1c7cd9-1636-426d-9d20-c863f0d9e7a2 [ 754.398484] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.398484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.398484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.398732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.398868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.398931] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb1c7cd9-1636-426d-9d20-c863f0d9e7a2 already deleted. [ 754.399009] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb1c7cd9-1636-426d-9d20-c863f0d9e7a2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.412124] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.412124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.479179] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85d35f16-322f-4fce-8671-2c59aba9257f in Status: SUCCESS [ 754.479417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.740435] env[62909]: INFO networking_nsxv3.common.synchronization [req-26be1ec7-4fe6-4269-bea5-498c40dfcda7 req-a272d577-8e9d-4a79-8e44-0e87f5ebc440 tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 754.741119] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 754.741440] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.741566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.741635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.741893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.742159] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.742274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.742333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.742493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.742588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.742712] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.800058] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.800232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.800232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.800396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.801182] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.801182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.801182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.801182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.801182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.801182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.801182] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.801477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.801477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.801477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.801574] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.801617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.802026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.802026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.802026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.802026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.802210] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.849833] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 754.850164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.850631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.850631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.850740] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.851490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.851490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.851490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.851490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.851490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.851490] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.904309] env[62909]: INFO networking_nsxv3.common.synchronization [req-9df777fc-cdd3-4011-8d64-b901bbb4b81c req-e22ca939-abfe-4728-bd62-b49b5b8ba4ad service nova] Enqueued Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_rules [ 754.904397] env[62909]: INFO networking_nsxv3.common.synchronization [req-9df777fc-cdd3-4011-8d64-b901bbb4b81c req-e22ca939-abfe-4728-bd62-b49b5b8ba4ad service nova] Enqueued Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 754.904455] env[62909]: INFO networking_nsxv3.common.synchronization [req-9df777fc-cdd3-4011-8d64-b901bbb4b81c req-e22ca939-abfe-4728-bd62-b49b5b8ba4ad service nova] Enqueued Resource ID: 691c01fe-1d59-431c-9474-7726ec537a5b with Priority: HIGHEST for action port [ 754.908734] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_rules [ 754.909033] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 754.909033] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 691c01fe-1d59-431c-9474-7726ec537a5b with Priority: HIGHEST for action port [ 754.909375] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.911016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.911100] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.911803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.911803] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.916062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.916062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.916062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.916062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.916062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.916062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.916062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.916062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.916062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.916062] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.916062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-691c01fe-1d59-431c-9474-7726ec537a5b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.916062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-691c01fe-1d59-431c-9474-7726ec537a5b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.916062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-691c01fe-1d59-431c-9474-7726ec537a5b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.916062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-691c01fe-1d59-431c-9474-7726ec537a5b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.916062] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('691c01fe-1d59-431c-9474-7726ec537a5b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.246670] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.246834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.246834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.247049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.247141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.247348] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.247450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.247606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.247774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.247848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.247935] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 already deleted. [ 755.248042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.306567] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e0b230b-d7d3-4c40-9cdd-92be876b4a05: rpc.has_security_group_logging(os_id): False [ 755.331366] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.331515] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.331573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.331777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.331879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.332103] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.332207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.332269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.335589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.335589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.335589] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.335589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.335589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.335589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.335589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.335589] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.335589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.335589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.335589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.335589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.335589] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be created. [ 755.353620] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.353795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.353884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.354116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.354290] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.354481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.354550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.355875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.355875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.355875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.355875] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.355875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.355875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.355875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.355875] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.355875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.355875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.356307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.356307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.356307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.356400] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.396360] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.396500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.396556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.396776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.397428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.409683] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 755.419315] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.419488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.419671] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.420643] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 691c01fe-1d59-431c-9474-7726ec537a5b with status ACTIVE [ 755.420825] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.420941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.421014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.421222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.421305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.421480] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.421580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.421639] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.421784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.421854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.422109] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.422172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.422231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.422368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.422437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.423517] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 691c01fe-1d59-431c-9474-7726ec537a5b is going to be updated. [ 755.469288] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.469490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.469490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.469971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.472207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.472207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-691c01fe-1d59-431c-9474-7726ec537a5b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.765983] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.766224] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.766442] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.766867] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.767897] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.768364] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.768364] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.768666] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.768846] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.769102] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.769248] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.769362] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.769472] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.769615] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.769721] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.769876] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.797063] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.797247] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 755.797394] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.797618] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.797930] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-392f2779-6bcf-4d28-9f9b-bd4279812dc7 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.798122] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-392f2779-6bcf-4d28-9f9b-bd4279812dc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.798327] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-392f2779-6bcf-4d28-9f9b-bd4279812dc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.798585] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-392f2779-6bcf-4d28-9f9b-bd4279812dc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.798728] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('392f2779-6bcf-4d28-9f9b-bd4279812dc7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.858935] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae9364a2-033c-455a-b65c-755fec76be27: rpc.has_security_group_logging(os_id): False [ 755.885027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.885027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.885027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.885027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.885721] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.885721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.885721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.886162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.886401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.886583] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 755.926499] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.976618] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.977071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.977289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.977683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.977989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.994728] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 756.302123] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.304338] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.304338] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.304338] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.304338] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.305397] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 392f2779-6bcf-4d28-9f9b-bd4279812dc7 not found, creating... [ 756.308019] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.308019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.308019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.308745] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.309095] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.310082] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.311052] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.311052] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.311052] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.311827] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.311963] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 392f2779-6bcf-4d28-9f9b-bd4279812dc7 is going to be created. [ 756.383671] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.384304] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.384515] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.384923] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.385193] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.385435] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-392f2779-6bcf-4d28-9f9b-bd4279812dc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.422410] env[62909]: INFO networking_nsxv3.common.synchronization [None req-6c118e94-ffdf-437c-9553-62a465f728ae None None] Enqueued Resource ID: 9892297a-64e9-4146-b508-25909ff1e52a with Priority: HIGHEST for action port [ 756.422978] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9892297a-64e9-4146-b508-25909ff1e52a with Priority: HIGHEST for action port [ 756.424270] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-9892297a-64e9-4146-b508-25909ff1e52a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.424270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9892297a-64e9-4146-b508-25909ff1e52a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.424270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9892297a-64e9-4146-b508-25909ff1e52a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.424270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9892297a-64e9-4146-b508-25909ff1e52a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.424270] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9892297a-64e9-4146-b508-25909ff1e52a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.428348] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.428613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.428613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.428821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.428928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.429301] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e is going to be created. [ 756.479990] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.480298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.480298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.480592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.480727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.506466] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: UNINITIALIZED for 2s [ 756.927111] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9892297a-64e9-4146-b508-25909ff1e52a [ 756.927448] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.927567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.927683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.927979] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.928147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.928304] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9892297a-64e9-4146-b508-25909ff1e52a already deleted. [ 756.928441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9892297a-64e9-4146-b508-25909ff1e52a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.428222] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 757.428222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.783529] env[62909]: INFO networking_nsxv3.common.synchronization [req-26be1ec7-4fe6-4269-bea5-498c40dfcda7 req-c27c75ed-a04d-4019-a808-b985ed7f0ed6 service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 757.783791] env[62909]: INFO networking_nsxv3.common.synchronization [req-26be1ec7-4fe6-4269-bea5-498c40dfcda7 req-c27c75ed-a04d-4019-a808-b985ed7f0ed6 service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 757.783944] env[62909]: INFO networking_nsxv3.common.synchronization [req-26be1ec7-4fe6-4269-bea5-498c40dfcda7 req-c27c75ed-a04d-4019-a808-b985ed7f0ed6 service nova] Enqueued Resource ID: 392f2779-6bcf-4d28-9f9b-bd4279812dc7 with Priority: HIGHEST for action port [ 757.784518] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 757.784646] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 757.784740] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392f2779-6bcf-4d28-9f9b-bd4279812dc7 with Priority: HIGHEST for action port [ 757.787306] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.787543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.788411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.789124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.789308] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.790768] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.794024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.794024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.794024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.794024] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.794024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.794024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.794024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.794024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.794024] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.794024] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-392f2779-6bcf-4d28-9f9b-bd4279812dc7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.794791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-392f2779-6bcf-4d28-9f9b-bd4279812dc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.794791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-392f2779-6bcf-4d28-9f9b-bd4279812dc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.794791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-392f2779-6bcf-4d28-9f9b-bd4279812dc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.794791] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('392f2779-6bcf-4d28-9f9b-bd4279812dc7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.017740] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 758.018211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.299116] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.300934] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.300934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.300934] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 392f2779-6bcf-4d28-9f9b-bd4279812dc7 with status ACTIVE [ 758.301320] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.301320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.301320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.301481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.302173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.302173] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.302173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.302173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.302727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.302823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.304354] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.304354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.304354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.304354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.304354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.304354] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 392f2779-6bcf-4d28-9f9b-bd4279812dc7 is going to be updated. [ 758.336926] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.337134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.337261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.337571] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.337816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.338141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-392f2779-6bcf-4d28-9f9b-bd4279812dc7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.517334] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: SUCCESS [ 758.517814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.518125] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.518854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.519404] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.519689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.519831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.520162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.520349] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.520562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.520786] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.806241] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.027087] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.027087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.027087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.027922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.027922] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.027922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.028097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.028221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.028363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.028474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.028643] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.028745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.028806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.028956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.029116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.029397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.029397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.029397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.029496] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.029802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.029802] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.187222] env[62909]: INFO networking_nsxv3.common.synchronization [None req-5b00f24c-a078-4ec9-b647-967d344651bf None None] Enqueued Resource ID: 91aa0ce1-a49f-49fb-9fdb-8787d99005fa with Priority: HIGHEST for action port [ 759.187740] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91aa0ce1-a49f-49fb-9fdb-8787d99005fa with Priority: HIGHEST for action port [ 759.188048] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-91aa0ce1-a49f-49fb-9fdb-8787d99005fa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.188253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91aa0ce1-a49f-49fb-9fdb-8787d99005fa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.188320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91aa0ce1-a49f-49fb-9fdb-8787d99005fa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.188644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91aa0ce1-a49f-49fb-9fdb-8787d99005fa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.188771] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91aa0ce1-a49f-49fb-9fdb-8787d99005fa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.310874] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.310874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.310874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.310874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.310874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.310874] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be created. [ 759.337326] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.337326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.337326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.337326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.337326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.352400] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: UNINITIALIZED for 2s [ 759.532343] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 009d27ce-c5b1-4df0-81b4-05b91e8ed19e: rpc.has_security_group_logging(os_id): False [ 759.553297] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.553519] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.553593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.553827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.553924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.554191] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.554303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.554452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.554656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.554736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.554961] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.556044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.556044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.556044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.556044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.556044] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.557778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.557912] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.558119] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.558239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.558360] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e is going to be created. [ 759.631530] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.631648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.631705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.632248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.632395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.649588] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: IN_PROGRESS for 2s [ 759.691744] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91aa0ce1-a49f-49fb-9fdb-8787d99005fa [ 759.691744] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.692043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.692109] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.692422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.692555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.692672] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91aa0ce1-a49f-49fb-9fdb-8787d99005fa already deleted. [ 759.692821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91aa0ce1-a49f-49fb-9fdb-8787d99005fa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.406930] env[62909]: INFO networking_nsxv3.common.synchronization [req-bdafc2e1-8386-4718-8715-bb9eb484c2ff req-062bd104-301e-43f8-9fd4-12440ff33b2f tempest-ServersTestManualDisk-1910117612 tempest-ServersTestManualDisk-1910117612-project-member] Enqueued Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_members [ 760.407439] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGHEST for action security_group_members [ 760.407753] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-35857353-01c5-40e5-800e-946a46ca0fc9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.407877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.407945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.411056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.411056] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.411056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.411056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.411056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.411056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.411056] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.913269] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.913490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.913600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.913919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.914063] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.914347] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.914488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.914587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.914800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.914918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.915060] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35857353-01c5-40e5-800e-946a46ca0fc9 is going to be updated. [ 760.947027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.947191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.947247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.947469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.947689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.958602] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35857353-01c5-40e5-800e-946a46ca0fc9 in Status: IN_PROGRESS for 2s [ 761.126537] env[62909]: INFO networking_nsxv3.common.synchronization [req-b6196a21-2de9-472d-bb15-84b0314f97fd req-21ba8f81-c966-439c-a4e7-26c8fe65b50f tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_members [ 761.127091] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_members [ 761.127401] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-70dd2e08-5d3c-47df-8c82-524cc320dde0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.127511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.127576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.133121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.133348] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.133467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.133537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.133716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.133801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.133897] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.371037] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 761.371499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.371823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.372190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.372591] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.372816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.373031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.375662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.375758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.375864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.376752] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.637966] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.638328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.638793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.639186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.641323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.641640] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.642297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.642449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.642709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.642836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.643069] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 already deleted. [ 761.643389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.666998] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: SUCCESS [ 761.669396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.878552] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.882314] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.882314] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.882314] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.882314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.883131] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.883131] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.921870] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.922987] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.922987] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.922987] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.924903] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.925157] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.925299] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.925550] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.925744] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.925995] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.926289] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.926361] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.926442] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.926583] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.926743] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.926913] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.949293] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.949344] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.949474] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.949720] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.950065] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-06e36426-302a-4bcd-bb7a-f9d6dd3a72c2 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.950232] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-06e36426-302a-4bcd-bb7a-f9d6dd3a72c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.950577] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-06e36426-302a-4bcd-bb7a-f9d6dd3a72c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.950727] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-06e36426-302a-4bcd-bb7a-f9d6dd3a72c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.951173] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06e36426-302a-4bcd-bb7a-f9d6dd3a72c2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.388135] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00039edf-d86f-462e-a706-bad2d411b887: rpc.has_security_group_logging(os_id): False [ 762.427228] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.427228] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.427228] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.427228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.428022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.428022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.428022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.428022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.428022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.428022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be created. [ 762.454507] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.454732] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.454874] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.455224] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.455334] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.455501] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 06e36426-302a-4bcd-bb7a-f9d6dd3a72c2 not found, creating... [ 762.455783] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.455977] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.456084] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.456320] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.456470] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.456762] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.456919] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.457369] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.457709] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.457899] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.458083] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 06e36426-302a-4bcd-bb7a-f9d6dd3a72c2 is going to be created. [ 762.480861] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.481183] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.481328] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.481673] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.481936] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.482206] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-06e36426-302a-4bcd-bb7a-f9d6dd3a72c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.495932] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.496305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.496305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.497019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.497019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.515239] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 762.968838] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35857353-01c5-40e5-800e-946a46ca0fc9 in Status: SUCCESS [ 762.969248] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35857353-01c5-40e5-800e-946a46ca0fc9 deletion is rescheduled due to dependency. [ 762.969248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.160945] env[62909]: INFO networking_nsxv3.common.synchronization [req-3d979676-3227-408f-bdd7-783610e58cd4 req-f3105292-b299-4043-aeeb-c947ad51d852 tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 763.161510] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 763.161830] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.161972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.162880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.163176] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.163389] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.163526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.163596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.164262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.164262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.164262] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.278402] env[62909]: INFO networking_nsxv3.common.synchronization [req-d9ea4721-1382-4a1d-8612-323f5a21db01 req-bc2512f2-bbcf-420a-a9f5-645667188bc4 tempest-ListServerFiltersTestJSON-403224292 tempest-ListServerFiltersTestJSON-403224292-project-member] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 763.279035] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 763.279380] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.279564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.279564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.279959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.280814] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.280925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.280987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.281208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.281328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.281427] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.662834] env[62909]: INFO networking_nsxv3.common.synchronization [req-b6196a21-2de9-472d-bb15-84b0314f97fd req-b87546f9-e034-477a-99e7-3bffee2f670a service nova] Enqueued Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_rules [ 763.663862] env[62909]: INFO networking_nsxv3.common.synchronization [req-b6196a21-2de9-472d-bb15-84b0314f97fd req-b87546f9-e034-477a-99e7-3bffee2f670a service nova] Enqueued Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_members [ 763.663862] env[62909]: INFO networking_nsxv3.common.synchronization [req-b6196a21-2de9-472d-bb15-84b0314f97fd req-b87546f9-e034-477a-99e7-3bffee2f670a service nova] Enqueued Resource ID: 06e36426-302a-4bcd-bb7a-f9d6dd3a72c2 with Priority: HIGHEST for action port [ 763.665211] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_rules [ 763.665211] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_members [ 763.665449] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e36426-302a-4bcd-bb7a-f9d6dd3a72c2 with Priority: HIGHEST for action port [ 763.665751] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70dd2e08-5d3c-47df-8c82-524cc320dde0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.666026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.666159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.666462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.666611] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.668367] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-70dd2e08-5d3c-47df-8c82-524cc320dde0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.668550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.668671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.669096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.669359] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.669497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.669580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.669782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.669878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.669977] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.670912] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.671108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.671211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.671509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.671588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.671834] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.672032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.672710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.672710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.672800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.672888] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 763.674413] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-06e36426-302a-4bcd-bb7a-f9d6dd3a72c2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.674573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06e36426-302a-4bcd-bb7a-f9d6dd3a72c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.674725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06e36426-302a-4bcd-bb7a-f9d6dd3a72c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.674876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06e36426-302a-4bcd-bb7a-f9d6dd3a72c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.674994] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06e36426-302a-4bcd-bb7a-f9d6dd3a72c2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.708704] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.709103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.709103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.709297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.709745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.719716] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 763.783517] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.783695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.784106] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.784559] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.784737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.785266] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.785444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.785558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.785820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.785971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.786406] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf1c820f-c032-491e-a171-042f82234545 already deleted. [ 763.786563] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.837432] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-654 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.837432] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.837432] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.838281] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.838525] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.838701] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.839310] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.840166] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.840166] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.840333] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.840333] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.840433] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.840484] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.840639] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.840731] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.840812] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.866084] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.866548] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 763.866797] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.867092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.868257] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-458d38ce-bc0b-471c-a588-9d31e99cbe74 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.868257] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-458d38ce-bc0b-471c-a588-9d31e99cbe74" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.868257] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-458d38ce-bc0b-471c-a588-9d31e99cbe74" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.868910] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-458d38ce-bc0b-471c-a588-9d31e99cbe74" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.868910] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('458d38ce-bc0b-471c-a588-9d31e99cbe74',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.178285] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.178285] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-70dd2e08-5d3c-47df-8c82-524cc320dde0 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.178285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.178758] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06e36426-302a-4bcd-bb7a-f9d6dd3a72c2 with status ACTIVE [ 764.178758] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.178758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.178887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.179070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.179144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.179261] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.179370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.179429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.179596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.179742] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.183022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.183022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.183022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.183022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.183022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.183022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06e36426-302a-4bcd-bb7a-f9d6dd3a72c2 is going to be updated. [ 764.208243] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.208399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.208455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.208687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.208846] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.209018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06e36426-302a-4bcd-bb7a-f9d6dd3a72c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.373668] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.373907] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.374048] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.374336] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.374481] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.374632] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 458d38ce-bc0b-471c-a588-9d31e99cbe74 not found, creating... [ 764.374892] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.375073] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.375246] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.375478] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.375610] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.375889] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.376154] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.376313] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.376558] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.376725] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.376921] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 458d38ce-bc0b-471c-a588-9d31e99cbe74 is going to be created. [ 764.428349] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.429034] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.429252] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.429793] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.430265] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.431146] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-458d38ce-bc0b-471c-a588-9d31e99cbe74" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.516172] env[62909]: INFO networking_nsxv3.common.synchronization [req-65210157-8ab3-4f6e-93e7-bcb16a7d940c req-bf2c7725-ff85-423b-ae44-5b59af99ec9e tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_members [ 764.516172] env[62909]: INFO networking_nsxv3.common.synchronization [req-65210157-8ab3-4f6e-93e7-bcb16a7d940c req-bf2c7725-ff85-423b-ae44-5b59af99ec9e tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 764.516172] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_members [ 764.516172] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 764.517896] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3015041e-e0eb-4083-abbf-3bfc49610323 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.518019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.518019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.518585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.518907] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.519197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.519302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.519628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.519792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.520021] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.522097] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.525151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.525237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.525438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.526015] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.526172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.526244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.526409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.526495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.526610] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.529475] env[62909]: INFO networking_nsxv3.common.synchronization [req-94816abd-771f-408a-a547-0f418309acc3 req-b3e12bfd-16d3-44d0-b98e-ee81ab688480 tempest-ServerRescueTestJSON-1768795781 tempest-ServerRescueTestJSON-1768795781-project-member] Enqueued Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 764.530520] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 764.530854] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.531012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.531285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.531860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.532020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.532381] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.532628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.532814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.533038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.533152] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.543604] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 764.543894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.620338] env[62909]: INFO networking_nsxv3.common.synchronization [req-65210157-8ab3-4f6e-93e7-bcb16a7d940c req-bf2c7725-ff85-423b-ae44-5b59af99ec9e tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_rules [ 764.620529] env[62909]: INFO networking_nsxv3.common.synchronization [req-65210157-8ab3-4f6e-93e7-bcb16a7d940c req-bf2c7725-ff85-423b-ae44-5b59af99ec9e tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_members [ 764.620692] env[62909]: INFO networking_nsxv3.common.synchronization [req-65210157-8ab3-4f6e-93e7-bcb16a7d940c req-bf2c7725-ff85-423b-ae44-5b59af99ec9e tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 764.620853] env[62909]: INFO networking_nsxv3.common.synchronization [req-65210157-8ab3-4f6e-93e7-bcb16a7d940c req-bf2c7725-ff85-423b-ae44-5b59af99ec9e tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 764.620988] env[62909]: INFO networking_nsxv3.common.synchronization [req-65210157-8ab3-4f6e-93e7-bcb16a7d940c req-bf2c7725-ff85-423b-ae44-5b59af99ec9e tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: c68776d2-73ad-4ec2-b114-31f5878098d8 with Priority: HIGHEST for action port [ 764.621495] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_rules [ 764.621663] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 764.621714] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c68776d2-73ad-4ec2-b114-31f5878098d8 with Priority: HIGHEST for action port [ 764.621810] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_members [ 764.621900] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 764.622570] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3015041e-e0eb-4083-abbf-3bfc49610323 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.622570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.622570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.622723] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.622859] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.624162] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.624647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.624647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.624647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.624852] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.626160] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c68776d2-73ad-4ec2-b114-31f5878098d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.626279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.626348] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.626521] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.626595] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c68776d2-73ad-4ec2-b114-31f5878098d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.627491] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3015041e-e0eb-4083-abbf-3bfc49610323 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.627491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.627764] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.627906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.680556] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.031940] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.031940] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.036714] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.128169] env[62909]: INFO networking_nsxv3.common.synchronization [req-d9ea4721-1382-4a1d-8612-323f5a21db01 req-1b029f1e-38fb-4412-8ead-ffc8c12dea76 service nova] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_rules [ 765.128338] env[62909]: INFO networking_nsxv3.common.synchronization [req-d9ea4721-1382-4a1d-8612-323f5a21db01 req-1b029f1e-38fb-4412-8ead-ffc8c12dea76 service nova] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 765.128479] env[62909]: INFO networking_nsxv3.common.synchronization [req-d9ea4721-1382-4a1d-8612-323f5a21db01 req-1b029f1e-38fb-4412-8ead-ffc8c12dea76 service nova] Enqueued Resource ID: 458d38ce-bc0b-471c-a588-9d31e99cbe74 with Priority: HIGHEST for action port [ 765.128879] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3015041e-e0eb-4083-abbf-3bfc49610323 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.129025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.129214] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.129300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.129450] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_rules [ 765.129573] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 765.129719] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458d38ce-bc0b-471c-a588-9d31e99cbe74 with Priority: HIGHEST for action port [ 765.130227] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c68776d2-73ad-4ec2-b114-31f5878098d8 with status ACTIVE [ 765.130395] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.130500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.130563] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.130821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.130894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.131020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.131139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.131192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.131344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.131418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.131594] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.131685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.131750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.131938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.132056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.132155] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c68776d2-73ad-4ec2-b114-31f5878098d8 is going to be updated. [ 765.133701] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.133813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.133880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.134103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.134183] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.135365] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.135482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.135539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.135694] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.135847] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.135964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.136040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.136185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.136287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.136339] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.137103] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-458d38ce-bc0b-471c-a588-9d31e99cbe74 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.137267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-458d38ce-bc0b-471c-a588-9d31e99cbe74" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.137267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-458d38ce-bc0b-471c-a588-9d31e99cbe74" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.137410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-458d38ce-bc0b-471c-a588-9d31e99cbe74" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.137480] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('458d38ce-bc0b-471c-a588-9d31e99cbe74',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.160338] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.160520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.160520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.160730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.160864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.161061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.184138] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.184580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.184580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.184660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.184755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.184854] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 is going to be created. [ 765.209279] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.209512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.209512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.209778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.209958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.228254] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 in Status: UNINITIALIZED for 2s [ 765.533152] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.535202] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.538880] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.640059] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.640692] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 458d38ce-bc0b-471c-a588-9d31e99cbe74 with status ACTIVE [ 765.640996] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.641438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.641602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.642108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.642183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.642359] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.642481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.642554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.642771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.642881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.643722] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.643722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.643722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.644059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.644059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.644059] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 458d38ce-bc0b-471c-a588-9d31e99cbe74 is going to be updated. [ 765.645458] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.645591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.670534] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.670534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.670677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.670860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.671013] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.671189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-458d38ce-bc0b-471c-a588-9d31e99cbe74" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.729489] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 765.729761] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f deletion is rescheduled due to dependency. [ 765.729922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.970742] env[62909]: INFO networking_nsxv3.common.synchronization [req-603ac7c5-d35f-42d7-a8f3-ee2766cc6eff req-3bd062de-153d-4025-9b1c-dd8881aa2693 tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 765.971344] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 765.971648] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.971769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.971831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.972261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.972322] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.972447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.972447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.973531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.973531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.973531] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.037693] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.037838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.037892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.038123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.038211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.038316] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3015041e-e0eb-4083-abbf-3bfc49610323 is going to be created. [ 766.040209] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.040209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.040322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.040532] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.041538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.041538] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 766.041968] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.042094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.042162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.042364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.042442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.042526] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d09a74b6-7c94-44f4-afba-b179607452eb is going to be updated. [ 766.078989] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.079214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.079322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.079583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.079819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.082776] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.082776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.082922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.083055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.083202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.085781] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.086783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.086783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.086783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.086783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.100708] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 766.101676] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: IN_PROGRESS for 2s [ 766.102767] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: UNINITIALIZED for 2s [ 766.146693] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.474906] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.475779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.475890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.476136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.476227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.476444] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.476729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.476823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.476986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.477154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.477243] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 already deleted. [ 766.477321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.617167] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.617167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.617167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.617400] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.618440] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.618636] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.618754] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.619441] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.619622] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.619902] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 766.620020] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.620142] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.620249] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.620359] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 766.620480] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.620627] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.642396] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.642558] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 766.642685] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.642864] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.643317] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-2de06f63-3449-4e6e-af95-5835f882045b taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.643501] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-2de06f63-3449-4e6e-af95-5835f882045b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.643623] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-2de06f63-3449-4e6e-af95-5835f882045b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.645307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-2de06f63-3449-4e6e-af95-5835f882045b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.645484] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2de06f63-3449-4e6e-af95-5835f882045b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.649294] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.649430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.649605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.649838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.649918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.649952] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be created. [ 766.684519] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff9c7b63-d375-4c99-a1e8-755ea7b56bcf req-aeca81f1-2e59-4da8-9104-2a272e5bac60 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_members [ 766.684652] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff9c7b63-d375-4c99-a1e8-755ea7b56bcf req-aeca81f1-2e59-4da8-9104-2a272e5bac60 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGHEST for action security_group_members [ 766.685033] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff9c7b63-d375-4c99-a1e8-755ea7b56bcf req-aeca81f1-2e59-4da8-9104-2a272e5bac60 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 766.685389] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_members [ 766.685463] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGHEST for action security_group_members [ 766.685521] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 766.686008] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3015041e-e0eb-4083-abbf-3bfc49610323 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.690447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.691137] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e414027f-367d-4f4e-abad-e74bd2a6a762 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.691313] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.691365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.691683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.691761] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.691833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.691899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.692066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.692151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.692258] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.693187] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.693274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.694626] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.694743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.694809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.694985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.697965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.700550] env[62909]: INFO networking_nsxv3.common.synchronization [req-25d3a533-cecb-42d5-8e81-bce036b77384 req-41bfc86a-f9fa-4023-a0a0-460b36dc9cdb tempest-ServersTestMultiNic-523841259 tempest-ServersTestMultiNic-523841259-project-member] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 766.702397] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 766.702397] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.702397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.702397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.702397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.702397] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.702397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.702397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.702397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.702931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.702931] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.710039] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: UNINITIALIZED for 2s [ 766.827156] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff9c7b63-d375-4c99-a1e8-755ea7b56bcf req-aeca81f1-2e59-4da8-9104-2a272e5bac60 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_rules [ 766.827334] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff9c7b63-d375-4c99-a1e8-755ea7b56bcf req-aeca81f1-2e59-4da8-9104-2a272e5bac60 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_members [ 766.827467] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff9c7b63-d375-4c99-a1e8-755ea7b56bcf req-aeca81f1-2e59-4da8-9104-2a272e5bac60 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 766.827592] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff9c7b63-d375-4c99-a1e8-755ea7b56bcf req-aeca81f1-2e59-4da8-9104-2a272e5bac60 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 766.827743] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff9c7b63-d375-4c99-a1e8-755ea7b56bcf req-aeca81f1-2e59-4da8-9104-2a272e5bac60 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGHEST for action security_group_rules [ 766.827876] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff9c7b63-d375-4c99-a1e8-755ea7b56bcf req-aeca81f1-2e59-4da8-9104-2a272e5bac60 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGHEST for action security_group_members [ 766.828008] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff9c7b63-d375-4c99-a1e8-755ea7b56bcf req-aeca81f1-2e59-4da8-9104-2a272e5bac60 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: c68776d2-73ad-4ec2-b114-31f5878098d8 with Priority: HIGHEST for action port [ 766.828486] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_rules [ 766.828618] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 766.828726] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGHEST for action security_group_members [ 766.828816] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c68776d2-73ad-4ec2-b114-31f5878098d8 with Priority: HIGHEST for action port [ 766.828913] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGHEST for action security_group_rules [ 766.829008] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_members [ 766.829110] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 766.829362] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3015041e-e0eb-4083-abbf-3bfc49610323 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.829471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.829650] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.829754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.829942] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e414027f-367d-4f4e-abad-e74bd2a6a762 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.830035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.830208] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c68776d2-73ad-4ec2-b114-31f5878098d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.830302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.830360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.830588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.830722] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c68776d2-73ad-4ec2-b114-31f5878098d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.831526] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e414027f-367d-4f4e-abad-e74bd2a6a762 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.831656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.831698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.831913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.832015] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.832711] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3015041e-e0eb-4083-abbf-3bfc49610323 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.832801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.837021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.837021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.103952] env[62909]: INFO networking_nsxv3.common.synchronization [req-25d3a533-cecb-42d5-8e81-bce036b77384 req-e4264b2e-39bc-4c2b-890e-6c3413673986 tempest-ServersTestMultiNic-523841259 tempest-ServersTestMultiNic-523841259-project-member] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 767.103952] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGHEST for action security_group_members [ 767.103952] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.103952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.147786] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.148110] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.148904] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.148904] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.149055] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.149179] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 2de06f63-3449-4e6e-af95-5835f882045b not found, creating... [ 767.149521] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.149753] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.149908] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.150247] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.150467] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.150938] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.151224] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.151366] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.151608] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.151746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.151890] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 2de06f63-3449-4e6e-af95-5835f882045b is going to be created. [ 767.175107] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.175310] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.175426] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.175709] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.176029] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.176150] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-2de06f63-3449-4e6e-af95-5835f882045b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.197778] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.210376] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.242081] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 in Status: SUCCESS [ 767.242341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.242485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.242785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.243037] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.243197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.243286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.243475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.243578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.243687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.243803] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.334846] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c68776d2-73ad-4ec2-b114-31f5878098d8 with status ACTIVE [ 767.335197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.335853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.335853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.335853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.335853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.336985] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.337207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.337312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.338266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.338266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.338266] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.338266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.338266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.338652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.338652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.338652] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c68776d2-73ad-4ec2-b114-31f5878098d8 is going to be updated. [ 767.339872] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e414027f-367d-4f4e-abad-e74bd2a6a762 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.340034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.372930] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.372930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.372930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.372930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.372930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.372930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c68776d2-73ad-4ec2-b114-31f5878098d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.701126] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.712313] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.745998] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.116368] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: SUCCESS [ 768.116879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.117978] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 768.118466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.119974] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: SUCCESS [ 768.120174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.120354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.120622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.120820] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.120935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.120980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.121177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.121259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.121317] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.122973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.126020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.126020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.126020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.126020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.126020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.126020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.126020] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.143453] env[62909]: INFO networking_nsxv3.common.synchronization [req-603ac7c5-d35f-42d7-a8f3-ee2766cc6eff req-2cc100f8-0831-4d08-bdcc-e4e8bb159cee service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 768.143633] env[62909]: INFO networking_nsxv3.common.synchronization [req-603ac7c5-d35f-42d7-a8f3-ee2766cc6eff req-2cc100f8-0831-4d08-bdcc-e4e8bb159cee service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 768.143768] env[62909]: INFO networking_nsxv3.common.synchronization [req-603ac7c5-d35f-42d7-a8f3-ee2766cc6eff req-2cc100f8-0831-4d08-bdcc-e4e8bb159cee service nova] Enqueued Resource ID: 2de06f63-3449-4e6e-af95-5835f882045b with Priority: HIGHEST for action port [ 768.144011] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 768.144152] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 768.144231] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2de06f63-3449-4e6e-af95-5835f882045b with Priority: HIGHEST for action port [ 768.144978] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.145170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.145244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.145674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.145674] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.150616] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.150616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.150616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.150616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.150616] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.150616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.150616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.150616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.150616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.150616] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.151418] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-2de06f63-3449-4e6e-af95-5835f882045b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.151719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2de06f63-3449-4e6e-af95-5835f882045b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.151822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2de06f63-3449-4e6e-af95-5835f882045b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.152659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2de06f63-3449-4e6e-af95-5835f882045b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.152860] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2de06f63-3449-4e6e-af95-5835f882045b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.204228] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.204494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.204580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.204748] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.205190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.205190] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e414027f-367d-4f4e-abad-e74bd2a6a762 is going to be created. [ 768.214667] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.214667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.214667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.214941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.214941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.215025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 768.237690] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.237980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.238104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.238406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.238631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.241697] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.241821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.241884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.242139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.243045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.248017] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70dd2e08-5d3c-47df-8c82-524cc320dde0: rpc.has_security_group_logging(os_id): False [ 768.250473] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 768.251496] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e414027f-367d-4f4e-abad-e74bd2a6a762 in Status: UNINITIALIZED for 2s [ 768.268554] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.268554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.268554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.268782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.269604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.269604] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.269604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.269604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.269604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.269604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.269604] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 is going to be created. [ 768.352860] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.352860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.352860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.352860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.352860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.370675] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 in Status: IN_PROGRESS for 2s [ 768.626028] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.627526] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.655406] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.656132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.661066] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2de06f63-3449-4e6e-af95-5835f882045b with status ACTIVE [ 768.661301] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.661447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.661527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.661734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.661828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.662021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.662134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.662209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.662425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.662425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.662817] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.662817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.662817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.663017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.663017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.663017] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2de06f63-3449-4e6e-af95-5835f882045b is going to be updated. [ 768.665167] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.687788] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.687946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.688127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.688354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.689103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.689336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2de06f63-3449-4e6e-af95-5835f882045b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.719805] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 768.720156] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.720250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.720477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.720804] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.720914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.720950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.721152] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.721229] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.721298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.721384] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.128491] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.129718] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.169456] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.228371] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.229535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.229953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.230427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.231054] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.232825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.233164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.233583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.233956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.234199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.234505] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.234743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.236892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.236892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.236892] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.236892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.236892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.236892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.236892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.236892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.236892] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.632967] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.632967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.632967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.632967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.632967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.632967] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 769.634382] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.634510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.634583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.634829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.634974] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.635524] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3015041e-e0eb-4083-abbf-3bfc49610323 is going to be updated. [ 769.669517] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.669795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.669875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.670032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.670186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.671925] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.672202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.672314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.672502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.672582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.672690] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be created. [ 769.674466] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.674583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.674645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.674812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.674935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.687991] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 769.689480] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: IN_PROGRESS for 2s [ 769.705459] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.705459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.705459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.705459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.705459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.720423] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: UNINITIALIZED for 2s [ 769.737906] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf1c820f-c032-491e-a171-042f82234545: rpc.has_security_group_logging(os_id): False [ 769.758405] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.758607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.758670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.758870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.759016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.759250] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.759360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.759419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.759597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.759807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.760069] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.760121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.760158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.760310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.760389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.760568] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.760662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.760769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.760967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.761175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.761269] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be created. [ 769.833792] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.833985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.834140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.834606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.834818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.849527] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 770.266032] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e414027f-367d-4f4e-abad-e74bd2a6a762 in Status: SUCCESS [ 770.266032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.266032] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 770.266032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.266414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.266414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.267029] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.267029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.267029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.267543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.267543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.267543] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.268797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.268988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.269161] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.269352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.269352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.269486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.269551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.269641] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.390315] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 in Status: SUCCESS [ 770.390315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.773629] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.777750] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.777893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.778034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.779126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.779126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.779126] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.779126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.779126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.779126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.779126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.779126] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be updated. [ 770.826233] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.826233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.826233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.826233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.826420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.846665] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: IN_PROGRESS for 2s [ 771.149783] env[62909]: INFO networking_nsxv3.common.synchronization [req-1ff635a8-2d7e-46d4-8f9b-e7243e718d6e req-32b1fd4c-97b2-4c66-811d-1b463b0788cb tempest-ServersTestJSON-1417391248 tempest-ServersTestJSON-1417391248-project-member] Enqueued Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_members [ 771.149783] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGHEST for action security_group_members [ 771.149783] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-2510be9a-503b-4668-a63b-e04e4a0997dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.149783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.149783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.149783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.149783] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.149783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.149783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.149783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.149783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.149783] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.283899] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.653378] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.653536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.653669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.653878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.653947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.654169] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.654339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.654381] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.654551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.654625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.654723] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2510be9a-503b-4668-a63b-e04e4a0997dc is going to be updated. [ 771.684424] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.685026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.685165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.687534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.687534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.698446] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2510be9a-503b-4668-a63b-e04e4a0997dc in Status: IN_PROGRESS for 2s [ 771.699467] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 771.701099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.701542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.701542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.702281] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.702455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.702549] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.702759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.702871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.702985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.703123] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.704695] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: SUCCESS [ 771.704903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.705112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.705321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.705521] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.705788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.705788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.705967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.706110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.706243] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.707076] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.707221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.707462] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.707617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.707726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.707902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.708405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.708524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.708701] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.709688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.709914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.710170] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.710317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.710410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.710582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.710692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.710805] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.730094] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 771.730322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.730489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.730765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.730939] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.731088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.731151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.731316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.731393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.731480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.731849] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.789515] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.790037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.790037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.790037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.790514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.790514] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e414027f-367d-4f4e-abad-e74bd2a6a762 is going to be updated. [ 771.833537] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.833731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.833731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.833947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.834094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.849251] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e414027f-367d-4f4e-abad-e74bd2a6a762 in Status: IN_PROGRESS for 2s [ 771.867875] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 771.868111] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.172682] env[62909]: INFO networking_nsxv3.common.synchronization [req-ba488a51-1e68-4472-8d5e-38fc7450ac08 req-6a01dad8-67cc-4879-baee-fb8b44a8dd67 tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 772.173394] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 772.174061] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.177056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.177056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.177056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.177056] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.177056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.177056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.177056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.177056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.177056] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.210976] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.212107] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.212235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.212611] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.213409] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.238187] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.238187] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.238187] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.238187] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.238187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.239019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.239019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.239019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.239019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.239019] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.681903] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.681903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.681903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.681903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.681903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.682319] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.682319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.682319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.682506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.682506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.683813] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 772.717400] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.717400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.717400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.717400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.717400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.719396] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.720740] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3015041e-e0eb-4083-abbf-3bfc49610323: rpc.has_security_group_logging(os_id): False [ 772.722165] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.732253] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 772.743176] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57568fd4-ee2b-43e3-a228-9a168490f0f5: rpc.has_security_group_logging(os_id): False [ 772.746688] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.747295] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.747295] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.749141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.749397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.749675] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.750327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.750327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.750327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.750327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.750327] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3015041e-e0eb-4083-abbf-3bfc49610323 is going to be created. [ 772.761526] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.761715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.761757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.761948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.762095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.762536] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.762536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.762536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.762765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.762765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.763912] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.763912] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.763912] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.763912] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.763912] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.764230] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.764230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.764310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.765022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.765022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.765022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be created. [ 772.814053] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.814053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.814053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.814053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.815306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.830253] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: IN_PROGRESS for 2s [ 772.831091] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.831210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.831274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.831498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.831681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.843907] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 772.857077] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae9364a2-033c-455a-b65c-755fec76be27 in Status: SUCCESS [ 772.857207] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae9364a2-033c-455a-b65c-755fec76be27 deletion is rescheduled due to dependency. [ 772.858210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.050800] env[62909]: INFO networking_nsxv3.common.synchronization [req-f639da85-5170-4027-bc14-c3a66c485170 req-7b335abb-e871-4ef7-bf7d-e82f1b2f444f tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 773.052268] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 773.052762] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.052974] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.053143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.053487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.053732] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.053938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.054090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.054539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.054539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.054686] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.225740] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.225740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.225740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.225740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.225740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.225740] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 773.225740] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.225740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.225740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.225740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.225740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.226450] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3015041e-e0eb-4083-abbf-3bfc49610323 is going to be updated. [ 773.278899] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.279106] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.279169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.279334] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.279628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.281690] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.281821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.281821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.282089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.282268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.299326] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 773.302157] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: IN_PROGRESS for 2s [ 773.450202] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.450372] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-667" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.450471] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-667" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.450875] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-667" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.451158] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.451789] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.452083] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.452346] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.452491] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.452706] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.452818] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.452924] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.453041] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.453150] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.453253] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.453382] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.476646] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.477025] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.477180] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.477459] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-667" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.477992] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-c2f62cb3-f405-432b-9d8c-8c08ea54e240 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.478314] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.478524] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.479078] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.479233] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2f62cb3-f405-432b-9d8c-8c08ea54e240',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.557070] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.557319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.557410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.557677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.557809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.558389] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.558389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.558389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.558646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.558646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.558646] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 already deleted. [ 773.558744] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.710614] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2510be9a-503b-4668-a63b-e04e4a0997dc in Status: SUCCESS [ 773.710823] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2510be9a-503b-4668-a63b-e04e4a0997dc deletion is rescheduled due to dependency. [ 773.710965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.864032] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e414027f-367d-4f4e-abad-e74bd2a6a762 in Status: SUCCESS [ 773.864032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.864032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.864032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.864032] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.864032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.864032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.864032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.864032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.864032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.864032] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.982420] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.982420] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.982420] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.982806] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.982806] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.982806] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port c2f62cb3-f405-432b-9d8c-8c08ea54e240 not found, creating... [ 773.983357] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.983357] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.983357] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.983607] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.983607] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.984537] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.984537] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.984537] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.984537] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.984537] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.985118] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: c2f62cb3-f405-432b-9d8c-8c08ea54e240 is going to be created. [ 774.005882] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.006118] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.006244] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.006520] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.006750] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.006973] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.367376] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.742902] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 774.743191] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 774.743874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.844081] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: SUCCESS [ 774.844376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.845861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.846376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.846547] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.858168] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 774.858532] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.873879] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e414027f-367d-4f4e-abad-e74bd2a6a762: rpc.has_security_group_logging(os_id): False [ 774.893581] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.893581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.893581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.893581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.893846] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.893846] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.893983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.894038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.894185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.894263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.894587] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e414027f-367d-4f4e-abad-e74bd2a6a762 is going to be created. [ 774.964417] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.964651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.964651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.964821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.965092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.982153] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e414027f-367d-4f4e-abad-e74bd2a6a762 in Status: IN_PROGRESS for 2s [ 775.038771] env[62909]: INFO networking_nsxv3.common.synchronization [req-f639da85-5170-4027-bc14-c3a66c485170 req-51a01655-8e8b-4bbf-80ab-b2175e9919b8 service nova] Enqueued Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_rules [ 775.038892] env[62909]: INFO networking_nsxv3.common.synchronization [req-f639da85-5170-4027-bc14-c3a66c485170 req-51a01655-8e8b-4bbf-80ab-b2175e9919b8 service nova] Enqueued Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 775.038978] env[62909]: INFO networking_nsxv3.common.synchronization [req-f639da85-5170-4027-bc14-c3a66c485170 req-51a01655-8e8b-4bbf-80ab-b2175e9919b8 service nova] Enqueued Resource ID: c2f62cb3-f405-432b-9d8c-8c08ea54e240 with Priority: HIGHEST for action port [ 775.039928] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_rules [ 775.040156] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 775.040280] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f62cb3-f405-432b-9d8c-8c08ea54e240 with Priority: HIGHEST for action port [ 775.040653] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.040829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.040915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.041188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.041288] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.042765] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.042938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.044378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.044699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.044962] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.045226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.045299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.045531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.045693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.045873] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.047136] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2f62cb3-f405-432b-9d8c-8c08ea54e240 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.047324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.047440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.049085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.049085] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2f62cb3-f405-432b-9d8c-8c08ea54e240',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.310809] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: SUCCESS [ 775.311633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.311633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.311770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.311918] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.312065] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.312116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.312278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.312329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.312445] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.313806] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 775.314017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.314175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.314338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.314494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.314592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.314669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.314816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.314887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.314971] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.351333] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3015041e-e0eb-4083-abbf-3bfc49610323 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.351333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.552757] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.553099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.553099] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.556078] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2f62cb3-f405-432b-9d8c-8c08ea54e240 with status ACTIVE [ 775.556078] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.556078] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.556078] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.556078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.556078] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2f62cb3-f405-432b-9d8c-8c08ea54e240 is going to be updated. [ 775.580540] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.580540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.580540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.581177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.581177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.581177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.816426] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.818940] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.061764] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.319554] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.324367] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.562349] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.562619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.562706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.562929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.563038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.563141] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 is going to be created. [ 776.596207] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.596447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.596715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.596972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.597193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.610302] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: UNINITIALIZED for 2s [ 776.825296] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.825733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.825733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.825882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.825966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.826086] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3015041e-e0eb-4083-abbf-3bfc49610323 is going to be updated. [ 776.827311] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.827429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.827488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.827671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.827798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.827959] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 776.860471] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.864085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.864251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.864460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.864611] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.866466] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.866589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.866650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.866837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.866964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.876581] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 776.877235] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: IN_PROGRESS for 2s [ 776.995404] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e414027f-367d-4f4e-abad-e74bd2a6a762 in Status: SUCCESS [ 776.996293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.229670] env[62909]: INFO networking_nsxv3.common.synchronization [req-81d3f29b-cd32-49e5-a578-0a16de65f975 req-2f332f2a-58e3-4664-bef8-68aba49bce5b tempest-ListServerFiltersTestJSON-403224292 tempest-ListServerFiltersTestJSON-403224292-project-member] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 778.230123] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 778.230937] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.230937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.230937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.230937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.230937] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.235139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.235139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.235365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.235424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.236447] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.626039] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: SUCCESS [ 778.626039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.626039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.630098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.630098] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.630098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.630098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.630098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.630098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.630098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.630098] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.673373] env[62909]: INFO networking_nsxv3.common.synchronization [None req-1ed2da0b-033c-4cea-bbda-988d8de05143 None None] Enqueued Resource ID: 62adbaa4-1bd6-4b19-a58b-60285bee710d with Priority: HIGHEST for action port [ 778.674126] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62adbaa4-1bd6-4b19-a58b-60285bee710d with Priority: HIGHEST for action port [ 778.674809] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-62adbaa4-1bd6-4b19-a58b-60285bee710d taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.674954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62adbaa4-1bd6-4b19-a58b-60285bee710d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.675293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62adbaa4-1bd6-4b19-a58b-60285bee710d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.675427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62adbaa4-1bd6-4b19-a58b-60285bee710d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.675701] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62adbaa4-1bd6-4b19-a58b-60285bee710d',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.740074] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.820136] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-654 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.820318] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.820777] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.820777] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.821447] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.821815] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.821815] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.822256] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.822327] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.822839] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 778.822839] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.822839] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.822972] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.823201] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 778.823249] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.823416] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.851241] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.851241] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 778.851241] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.851621] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.851795] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.852151] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.852282] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.852623] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.852762] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.888970] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: SUCCESS [ 778.889312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.889530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.890558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.890558] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.890558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.890558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.890558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.890558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.890558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.890995] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.892379] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 778.892556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.893116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.893352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.894751] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.894950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.895079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.895282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.895372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.895497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.895700] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.895835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.895895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.896078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.896259] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.896679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.896679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.896679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.896679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.896841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.896875] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.134977] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.134977] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.134977] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.134977] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.134977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.135982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.135982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.135982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.135982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.135982] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.179153] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62adbaa4-1bd6-4b19-a58b-60285bee710d [ 779.179153] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.179153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.179153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.179153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.179607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.179801] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62adbaa4-1bd6-4b19-a58b-60285bee710d already deleted. [ 779.179936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62adbaa4-1bd6-4b19-a58b-60285bee710d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.243678] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.355960] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.356056] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.356235] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.356693] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.356693] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.356833] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1 not found, creating... [ 779.357110] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.359533] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.359533] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.359533] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.359533] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.359533] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.359533] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.359533] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.359533] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.359980] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.361363] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1 is going to be created. [ 779.387305] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.387305] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.388887] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.389437] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.389724] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.390009] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.398729] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.401030] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e0b230b-d7d3-4c40-9cdd-92be876b4a05: rpc.has_security_group_logging(os_id): False [ 779.426576] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.426735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.426808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.427041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.427136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.427333] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.427433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.427634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.427634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.427769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.427963] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.428050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.428115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.428258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.428330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.428509] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.428599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.428658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.428827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.428871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.428934] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 779.525528] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.525528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.525528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.525972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.527076] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.543266] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 779.637824] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7b422f-c1c0-41cd-91df-fa408193f5a3: rpc.has_security_group_logging(os_id): False [ 779.681126] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.681126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.681401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.681742] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.681742] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.681742] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.681881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.681881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.682851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.682851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.682851] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.683336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.683336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.683336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.683336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.683537] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.683537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.683624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.683730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.683778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.683846] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 is going to be created. [ 779.748746] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.748746] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.748746] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.748896] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.748954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.749819] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be updated. [ 779.772575] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.772789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.772789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.772984] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.773181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.791122] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: IN_PROGRESS for 2s [ 779.799984] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.800146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.800212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.800425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.800570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.811074] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 779.903780] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3015041e-e0eb-4083-abbf-3bfc49610323: rpc.has_security_group_logging(os_id): False [ 779.925702] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.926446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.926446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.926446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.926602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.926894] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.927067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.929455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.929455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.929455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.929455] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3015041e-e0eb-4083-abbf-3bfc49610323 is going to be updated. [ 780.023364] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.023364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.023364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.023364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.023364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.044139] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: IN_PROGRESS for 2s [ 780.207197] env[62909]: INFO networking_nsxv3.common.synchronization [req-81d3f29b-cd32-49e5-a578-0a16de65f975 req-a3e19b0f-b113-4be1-a228-cf952dd1f28f service nova] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_rules [ 780.207432] env[62909]: INFO networking_nsxv3.common.synchronization [req-81d3f29b-cd32-49e5-a578-0a16de65f975 req-a3e19b0f-b113-4be1-a228-cf952dd1f28f service nova] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 780.207590] env[62909]: INFO networking_nsxv3.common.synchronization [req-81d3f29b-cd32-49e5-a578-0a16de65f975 req-a3e19b0f-b113-4be1-a228-cf952dd1f28f service nova] Enqueued Resource ID: 08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1 with Priority: HIGHEST for action port [ 780.212392] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_rules [ 780.212607] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 780.212673] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1 with Priority: HIGHEST for action port [ 780.213021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.213157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.213223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.213464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.213547] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.215740] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.217468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.217727] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.218271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.218271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.218271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.218271] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.721107] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.721441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.721441] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1 with status ACTIVE [ 780.721568] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.721764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.721764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.721932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.722150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.722298] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.722298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.722382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.722566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.722566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.726327] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.726327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.726327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.726327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.726327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.726327] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1 is going to be updated. [ 780.746976] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.746976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.747237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.747289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.747400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.747560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08e0b9bd-1c95-4c6f-919b-4c05e8ef81d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.562920] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 781.563640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.563868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.564144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.564255] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.670300] env[62909]: INFO networking_nsxv3.common.synchronization [None req-f5b37f56-77bc-4a77-a0af-70079eb92b46 None None] Enqueued Resource ID: 4c110a70-93f5-422c-b74e-7eab7e8e37df with Priority: HIGHEST for action port [ 781.670300] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c110a70-93f5-422c-b74e-7eab7e8e37df with Priority: HIGHEST for action port [ 781.670751] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c110a70-93f5-422c-b74e-7eab7e8e37df taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.671148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c110a70-93f5-422c-b74e-7eab7e8e37df" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.671396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c110a70-93f5-422c-b74e-7eab7e8e37df" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.672010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c110a70-93f5-422c-b74e-7eab7e8e37df" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.672287] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c110a70-93f5-422c-b74e-7eab7e8e37df',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.809378] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: SUCCESS [ 781.809686] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.821617] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 781.821836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.822011] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.822224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.824084] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.824084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.824084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.824084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.824084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.824084] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.059778] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: SUCCESS [ 782.060130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.068557] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.068782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.069021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.069319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.069542] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.069681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.069784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.069988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.070491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.070491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.070491] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.175702] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c110a70-93f5-422c-b74e-7eab7e8e37df [ 782.175920] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.176193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.176193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.176358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.176446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.176541] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c110a70-93f5-422c-b74e-7eab7e8e37df already deleted. [ 782.176621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c110a70-93f5-422c-b74e-7eab7e8e37df" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.327169] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.573555] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.573713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.573786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.574067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.574261] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.575075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.575075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.575075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.575075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.575075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.575075] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.575075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.575506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.575506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.575506] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.575506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.575683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.575683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.576264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.576264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.576264] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.830965] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.079662] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e0b230b-d7d3-4c40-9cdd-92be876b4a05: rpc.has_security_group_logging(os_id): False [ 783.098316] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.098452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.098527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.098739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.098823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.099019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.099122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.099189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.099338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.099414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.099617] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.099711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.099773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.099946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.100025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.100207] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.100289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.100351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.100482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.100576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.100633] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 783.171926] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.172100] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.172215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.172463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.172572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.191416] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 783.336035] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.336517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.341596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.341596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.341596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.341596] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be updated. [ 783.376907] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.377281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.377487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.377810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.378104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.390104] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 785.210204] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 785.210520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.400341] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 785.400575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.403827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.404145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.404355] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.404482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.404556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.404707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.404790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.404878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.404970] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.677335] env[62909]: INFO networking_nsxv3.common.synchronization [None req-f10779da-82d1-46bc-b50a-905db9937dba None None] Enqueued Resource ID: 01669535-09b4-4798-8c6d-42cdab6c72b9 with Priority: HIGHEST for action port [ 785.677335] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01669535-09b4-4798-8c6d-42cdab6c72b9 with Priority: HIGHEST for action port [ 785.677442] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-01669535-09b4-4798-8c6d-42cdab6c72b9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.677514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01669535-09b4-4798-8c6d-42cdab6c72b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.677548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01669535-09b4-4798-8c6d-42cdab6c72b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.680040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01669535-09b4-4798-8c6d-42cdab6c72b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.680040] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01669535-09b4-4798-8c6d-42cdab6c72b9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.908104] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.908317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.908364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.908557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.908731] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.908833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.908897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.909056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.909147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.909234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.909414] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.909544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.909620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.910062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.910242] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.910353] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.910419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.910572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.910656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.910741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.910839] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.184387] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01669535-09b4-4798-8c6d-42cdab6c72b9 [ 786.184658] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.184762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.184820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.185058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.185155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.185250] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01669535-09b4-4798-8c6d-42cdab6c72b9 already deleted. [ 786.185330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01669535-09b4-4798-8c6d-42cdab6c72b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.415490] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf1c820f-c032-491e-a171-042f82234545: rpc.has_security_group_logging(os_id): False [ 786.439355] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.439580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.439580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.439777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.439877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.440116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.440227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.440287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.440447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.440523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.440699] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.440835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.440898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.444032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.444032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.444032] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.444032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.444032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.444032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.444032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.444032] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be updated. [ 786.569627] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.570145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.570329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.570631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.571760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.612672] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 787.248604] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.248604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.248604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.248604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.248604] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.751576] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.254435] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.633425] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 788.634252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.761189] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 788.761189] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 788.770165] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ec9b2fe4-f2c6-4270-a170-e92815a23ed1 None None] Enqueued Resource ID: b079e148-0450-41d5-8c0c-a9a2c7af724e with Priority: HIGHEST for action port [ 788.771067] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b079e148-0450-41d5-8c0c-a9a2c7af724e with Priority: HIGHEST for action port [ 788.771167] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b079e148-0450-41d5-8c0c-a9a2c7af724e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.771313] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b079e148-0450-41d5-8c0c-a9a2c7af724e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.771388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b079e148-0450-41d5-8c0c-a9a2c7af724e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.771655] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b079e148-0450-41d5-8c0c-a9a2c7af724e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.771729] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b079e148-0450-41d5-8c0c-a9a2c7af724e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.280268] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b079e148-0450-41d5-8c0c-a9a2c7af724e [ 789.280494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.280654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.280747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.280971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.281086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.281184] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b079e148-0450-41d5-8c0c-a9a2c7af724e already deleted. [ 789.281184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b079e148-0450-41d5-8c0c-a9a2c7af724e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.633797] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.634015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.634105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.634358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.652248] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 789.810744] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.812011] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 789.841978] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.842181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.842260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.842472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.850622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.851380] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 789.851513] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 789.851565] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 789.896485] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.896485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.896485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.896485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.897814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.898046] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 790.011250] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.011250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.011250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.011250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.011250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.011250] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 790.078346] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.078346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.078346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.078346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.078346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.078346] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 790.078346] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'70dd2e08-5d3c-47df-8c82-524cc320dde0', '3153bb13-485b-4639-83ed-2a27b9bcedf0', '69f700c8-ea6e-4561-84ab-c40836ff4286', 'c2b03ac3-37c4-4e87-91a0-aaa294062815', '73e434cf-a3e8-49df-8050-fa1d2489f7dc', '2510be9a-503b-4668-a63b-e04e4a0997dc', '228de352-6a6b-498f-b01b-4fc933940457', 'd6981999-a42c-4650-befd-1111c3f609ec', 'fe2d83f4-67d0-4b35-90a2-f919bc3f65bb', 'a79ba361-9edb-4b9b-82c4-afa586cb4427', '6d635d2b-1797-4206-b032-b7450c1074bc', '23297eee-5815-4160-b6ed-90818fa0ab3a', 'bf1c820f-c032-491e-a171-042f82234545', '57568fd4-ee2b-43e3-a228-9a168490f0f5', 'e414027f-367d-4f4e-abad-e74bd2a6a762', 'ae9364a2-033c-455a-b65c-755fec76be27', 'b723f584-c976-4351-bfcd-6ca761e670dd', 'f7554444-3d48-4fef-b5ad-54687b70bfc1', '1f6e0db7-41ba-43f5-b841-2551ea96a39f', '35857353-01c5-40e5-800e-946a46ca0fc9', '24030e1e-897b-4a91-9a5a-7c9e92186e4b', '3015041e-e0eb-4083-abbf-3bfc49610323', '59435e15-2dcf-4317-816e-1fcd9a40b9fb', 'bef0125d-be94-4dc6-922c-269322ae2b97', '7e66bfb9-974f-43a6-93f8-54f17b7d81b3', '828a3fee-5001-4141-bcfb-64c185ab0efa', 'b2821bc4-3047-4598-bd51-10cd2a5b1137', 'cc7b422f-c1c0-41cd-91df-fa408193f5a3', 'cdf04703-55f3-479f-bb4c-a69bd221f98f', '14d66eff-4d06-4f86-92c4-66d09f1004ca', '00039edf-d86f-462e-a706-bad2d411b887', 'f599ba98-bf73-4cc1-922f-b14d6ba06469', '9854b6b4-9fde-4807-83f9-b2838c42920a', '85d35f16-322f-4fce-8671-2c59aba9257f', '91426ce9-c57f-42ef-bcee-74c76f9876e0', '037af277-a74d-482c-b3ec-c4b5f5f92980', '7e0b230b-d7d3-4c40-9cdd-92be876b4a05', '11f84bbc-cc8c-4244-87ea-1493e7543f81', '009d27ce-c5b1-4df0-81b4-05b91e8ed19e', 'd09a74b6-7c94-44f4-afba-b179607452eb', 'ba398af1-904a-41aa-b098-1f2b15a308ac'} {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 790.078346] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 790.100980] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.100980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.100980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.100980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.100980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.100980] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 790.100980] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 790.100980] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 790.174303] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.174525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.174646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.174966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.178114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.178114] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 790.178114] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 790.178114] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 790.178114] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 790.178114] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 790.178114] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGH for action security_group_rules [ 790.178114] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 with Priority: HIGH for action security_group_rules [ 790.178438] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 with Priority: HIGH for action security_group_rules [ 790.178544] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 with Priority: HIGH for action security_group_rules [ 790.178676] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc with Priority: HIGH for action security_group_rules [ 790.179108] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGH for action security_group_rules [ 790.179108] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 228de352-6a6b-498f-b01b-4fc933940457 with Priority: HIGH for action security_group_rules [ 790.179253] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6981999-a42c-4650-befd-1111c3f609ec with Priority: HIGH for action security_group_rules [ 790.179427] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb with Priority: HIGH for action security_group_rules [ 790.179510] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGH for action security_group_rules [ 790.179702] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGH for action security_group_rules [ 790.179751] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGH for action security_group_rules [ 790.179893] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGH for action security_group_rules [ 790.179974] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGH for action security_group_rules [ 790.180102] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGH for action security_group_rules [ 790.180212] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGH for action security_group_rules [ 790.180568] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGH for action security_group_rules [ 790.180568] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 with Priority: HIGH for action security_group_rules [ 790.180568] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGH for action security_group_rules [ 790.180772] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGH for action security_group_rules [ 790.180869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.752556] env[62909]: INFO networking_nsxv3.common.synchronization [None req-1c7ee112-1004-4e26-8a9d-49163791db93 None None] Enqueued Resource ID: b25e7ec4-fc3e-423a-b45e-3d24a914b887 with Priority: HIGHEST for action port [ 793.752556] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b25e7ec4-fc3e-423a-b45e-3d24a914b887 with Priority: HIGHEST for action port [ 793.752957] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGH for action security_group_rules [ 793.752957] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 with Priority: HIGH for action security_group_rules [ 793.752957] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 228de352-6a6b-498f-b01b-4fc933940457 with Priority: HIGH for action security_group_rules [ 793.752957] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGH for action security_group_rules [ 793.753112] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35857353-01c5-40e5-800e-946a46ca0fc9 with Priority: HIGH for action security_group_rules [ 793.753112] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b723f584-c976-4351-bfcd-6ca761e670dd with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9364a2-033c-455a-b65c-755fec76be27 with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d635d2b-1797-4206-b032-b7450c1074bc with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2510be9a-503b-4668-a63b-e04e4a0997dc with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6981999-a42c-4650-befd-1111c3f609ec with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 with Priority: HIGH for action security_group_rules [ 793.754562] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 with Priority: HIGH for action security_group_rules [ 793.755280] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b25e7ec4-fc3e-423a-b45e-3d24a914b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.755280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b25e7ec4-fc3e-423a-b45e-3d24a914b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.755280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b25e7ec4-fc3e-423a-b45e-3d24a914b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.755280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b25e7ec4-fc3e-423a-b45e-3d24a914b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.755431] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b25e7ec4-fc3e-423a-b45e-3d24a914b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.756458] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70dd2e08-5d3c-47df-8c82-524cc320dde0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.756458] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.756611] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.756860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.756860] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.757486] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f700c8-ea6e-4561-84ab-c40836ff4286 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.757579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.757579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.757730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.757793] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f700c8-ea6e-4561-84ab-c40836ff4286',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.758440] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-228de352-6a6b-498f-b01b-4fc933940457 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.758534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.758652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.759049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.759049] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('228de352-6a6b-498f-b01b-4fc933940457',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.759556] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e414027f-367d-4f4e-abad-e74bd2a6a762 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.759636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.759706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.759852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.759941] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.760934] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35857353-01c5-40e5-800e-946a46ca0fc9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.762887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.763022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.763163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.763237] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35857353-01c5-40e5-800e-946a46ca0fc9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.764168] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.764275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.764399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.764626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.764626] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.765708] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7554444-3d48-4fef-b5ad-54687b70bfc1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.765708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.765708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.765708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.765936] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7554444-3d48-4fef-b5ad-54687b70bfc1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.767357] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b723f584-c976-4351-bfcd-6ca761e670dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.767357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.767357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.767357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.767357] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b723f584-c976-4351-bfcd-6ca761e670dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.767733] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.767823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.767989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.768057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.768207] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.768890] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae9364a2-033c-455a-b65c-755fec76be27 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.768999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.769070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.769208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.769432] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae9364a2-033c-455a-b65c-755fec76be27',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.769576] env[62909]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 793.770312] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.770415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.770657] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.770657] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.770804] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.771470] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.771680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.771680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.771785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.771827] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.772732] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d635d2b-1797-4206-b032-b7450c1074bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.772732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.772980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.772980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.772980] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d635d2b-1797-4206-b032-b7450c1074bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.773833] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a79ba361-9edb-4b9b-82c4-afa586cb4427 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.773930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.774014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.774154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.774214] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a79ba361-9edb-4b9b-82c4-afa586cb4427',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.775072] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.775072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.775206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.775495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.775495] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe2d83f4-67d0-4b35-90a2-f919bc3f65bb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.776115] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2510be9a-503b-4668-a63b-e04e4a0997dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.776257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.776306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.776477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.776477] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2510be9a-503b-4668-a63b-e04e4a0997dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.777333] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6981999-a42c-4650-befd-1111c3f609ec taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.777433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.777499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.777640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.777701] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6981999-a42c-4650-befd-1111c3f609ec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.778484] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73e434cf-a3e8-49df-8050-fa1d2489f7dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.778590] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.778650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.778796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.779036] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73e434cf-a3e8-49df-8050-fa1d2489f7dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.779626] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3153bb13-485b-4639-83ed-2a27b9bcedf0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.779764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.779815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.779967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.780050] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3153bb13-485b-4639-83ed-2a27b9bcedf0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.780905] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2b03ac3-37c4-4e87-91a0-aaa294062815 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.781037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.781082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.781275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.781275] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2b03ac3-37c4-4e87-91a0-aaa294062815',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.781484] env[62909]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 793.787572] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b25e7ec4-fc3e-423a-b45e-3d24a914b887 [ 793.787881] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.787881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.788039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.788247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.788347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.788439] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b25e7ec4-fc3e-423a-b45e-3d24a914b887 already deleted. [ 793.788519] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b25e7ec4-fc3e-423a-b45e-3d24a914b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.788870] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-70dd2e08-5d3c-47df-8c82-524cc320dde0 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.788972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.789039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.789191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.789332] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.789422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.789478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.789610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.789681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.789760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.789843] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.814687] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.814843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.814904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.815132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.816905] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.816982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.832733] env[62909]: INFO networking_nsxv3.common.synchronization [req-78874605-4db0-4db6-9d9e-cc32c4aeb771 req-e0b1be2d-6a7c-4f5f-afad-8aa7b81c37f2 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 793.832883] env[62909]: INFO networking_nsxv3.common.synchronization [req-78874605-4db0-4db6-9d9e-cc32c4aeb771 req-e0b1be2d-6a7c-4f5f-afad-8aa7b81c37f2 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: f46ad058-cb41-404b-863c-078d919d7dec with Priority: HIGHEST for action security_group_members [ 793.833365] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 793.833513] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46ad058-cb41-404b-863c-078d919d7dec with Priority: HIGHEST for action security_group_members [ 793.833909] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.834217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.835340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.835340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.835340] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.835340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.835340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.835340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.835340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.835340] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.836075] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46ad058-cb41-404b-863c-078d919d7dec taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.836170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.836451] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.836899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.836955] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.837124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.837187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.837329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.837409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.837507] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46ad058-cb41-404b-863c-078d919d7dec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.845247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.845247] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f700c8-ea6e-4561-84ab-c40836ff4286 is going to be deleted. [ 793.846066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.846619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.882478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.882478] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 228de352-6a6b-498f-b01b-4fc933940457 is going to be deleted. [ 793.908665] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.908887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.908887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.909120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.909182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.909319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f700c8-ea6e-4561-84ab-c40836ff4286" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.918441] env[62909]: INFO networking_nsxv3.common.synchronization [req-78874605-4db0-4db6-9d9e-cc32c4aeb771 req-e0b1be2d-6a7c-4f5f-afad-8aa7b81c37f2 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_rules [ 793.918441] env[62909]: INFO networking_nsxv3.common.synchronization [req-78874605-4db0-4db6-9d9e-cc32c4aeb771 req-e0b1be2d-6a7c-4f5f-afad-8aa7b81c37f2 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 793.918441] env[62909]: INFO networking_nsxv3.common.synchronization [req-78874605-4db0-4db6-9d9e-cc32c4aeb771 req-e0b1be2d-6a7c-4f5f-afad-8aa7b81c37f2 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: f46ad058-cb41-404b-863c-078d919d7dec with Priority: HIGHEST for action security_group_rules [ 793.918441] env[62909]: INFO networking_nsxv3.common.synchronization [req-78874605-4db0-4db6-9d9e-cc32c4aeb771 req-e0b1be2d-6a7c-4f5f-afad-8aa7b81c37f2 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: f46ad058-cb41-404b-863c-078d919d7dec with Priority: HIGHEST for action security_group_members [ 793.918441] env[62909]: INFO networking_nsxv3.common.synchronization [req-78874605-4db0-4db6-9d9e-cc32c4aeb771 req-e0b1be2d-6a7c-4f5f-afad-8aa7b81c37f2 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: c2f62cb3-f405-432b-9d8c-8c08ea54e240 with Priority: HIGHEST for action port [ 793.925707] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_rules [ 793.925707] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46ad058-cb41-404b-863c-078d919d7dec with Priority: HIGHEST for action security_group_rules [ 793.925707] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f62cb3-f405-432b-9d8c-8c08ea54e240 with Priority: HIGHEST for action port [ 793.925707] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 793.925707] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46ad058-cb41-404b-863c-078d919d7dec with Priority: HIGHEST for action security_group_members [ 793.926722] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.926722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.926848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.927584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.927584] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.929430] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f46ad058-cb41-404b-863c-078d919d7dec taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.929430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.929430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.929430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.929430] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f46ad058-cb41-404b-863c-078d919d7dec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.930812] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2f62cb3-f405-432b-9d8c-8c08ea54e240 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.930812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.930998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.931518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.931518] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2f62cb3-f405-432b-9d8c-8c08ea54e240',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.931959] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.932118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.932364] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46ad058-cb41-404b-863c-078d919d7dec taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.932463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.933573] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.933678] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.933769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.933910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.935061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.935061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-228de352-6a6b-498f-b01b-4fc933940457" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.294989] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.329708] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e414027f-367d-4f4e-abad-e74bd2a6a762 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.329708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.329708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.330041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.330041] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.330129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.330167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.330311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.330392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.330479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.330564] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.347524] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.347524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.347524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.347524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.347524] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.347524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.347524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.347524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.347524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.347524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.347524] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.353029] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.353646] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.353646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.353646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.353787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.353832] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.354162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.354162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.354162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.354309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.354309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.354371] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.362218] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.362218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.362218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.362482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.362545] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.362633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.362691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.362828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.362901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.363478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.363478] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.364773] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f46ad058-cb41-404b-863c-078d919d7dec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.370538] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.370538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.370538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.370538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.379042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.379219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.413828] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.414139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.414901] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.414901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.422247] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.422459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.424784] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.425025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.425755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.425867] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2510be9a-503b-4668-a63b-e04e4a0997dc is going to be deleted. [ 794.426804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.427433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.430265] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.430265] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.431055] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.431226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.432583] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.433205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.434504] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.434697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.435522] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46ad058-cb41-404b-863c-078d919d7dec taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.435522] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.436388] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.436388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.436388] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2f62cb3-f405-432b-9d8c-8c08ea54e240 with status ACTIVE [ 794.436388] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.436388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.436702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.436702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.436702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.436871] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.436963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.437153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.437310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.437393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.437577] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.437670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.437730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.437967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.438050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.438148] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2f62cb3-f405-432b-9d8c-8c08ea54e240 is going to be updated. [ 794.440030] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.440146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.451408] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.451536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.452367] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.452451] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.466575] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 794.466941] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.467117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.467224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.467417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.467555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.467718] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.476049] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 794.476506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.476604] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae9364a2-033c-455a-b65c-755fec76be27 is going to be deleted. [ 794.478169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.478169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.506043] env[62909]: INFO networking_nsxv3.common.synchronization [req-47e37f68-159e-4877-a525-0929fb19dde6 req-6a84d8d4-bc38-4867-bab0-06ceca39de49 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 794.506145] env[62909]: INFO networking_nsxv3.common.synchronization [req-47e37f68-159e-4877-a525-0929fb19dde6 req-6a84d8d4-bc38-4867-bab0-06ceca39de49 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: f46ad058-cb41-404b-863c-078d919d7dec with Priority: HIGHEST for action security_group_members [ 794.511305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.511566] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6981999-a42c-4650-befd-1111c3f609ec is going to be deleted. [ 794.513068] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.513216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.513258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.513524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.513524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.513645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2510be9a-503b-4668-a63b-e04e4a0997dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.514156] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 794.514374] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46ad058-cb41-404b-863c-078d919d7dec with Priority: HIGHEST for action security_group_members [ 794.514678] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.514855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.519130] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.519259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.519438] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46ad058-cb41-404b-863c-078d919d7dec taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.519697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.567750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.567922] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2b03ac3-37c4-4e87-91a0-aaa294062815 is going to be deleted. [ 794.568983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.570697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.572296] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.572425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.609140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.609140] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73e434cf-a3e8-49df-8050-fa1d2489f7dc is going to be deleted. [ 794.610732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.611175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.614684] env[62909]: INFO networking_nsxv3.common.synchronization [req-47e37f68-159e-4877-a525-0929fb19dde6 req-6a84d8d4-bc38-4867-bab0-06ceca39de49 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_rules [ 794.614865] env[62909]: INFO networking_nsxv3.common.synchronization [req-47e37f68-159e-4877-a525-0929fb19dde6 req-6a84d8d4-bc38-4867-bab0-06ceca39de49 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 794.615372] env[62909]: INFO networking_nsxv3.common.synchronization [req-47e37f68-159e-4877-a525-0929fb19dde6 req-6a84d8d4-bc38-4867-bab0-06ceca39de49 tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: c2f62cb3-f405-432b-9d8c-8c08ea54e240 with Priority: HIGHEST for action port [ 794.616074] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_rules [ 794.616196] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 794.616369] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f62cb3-f405-432b-9d8c-8c08ea54e240 with Priority: HIGHEST for action port [ 794.618768] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.618768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.618768] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.618768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.618768] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2f62cb3-f405-432b-9d8c-8c08ea54e240 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.618768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.618768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.618768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.618768] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2f62cb3-f405-432b-9d8c-8c08ea54e240',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.698317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.698479] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe2d83f4-67d0-4b35-90a2-f919bc3f65bb is going to be deleted. [ 794.699509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.699842] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.706704] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.706915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.735025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.737317] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35857353-01c5-40e5-800e-946a46ca0fc9 is going to be deleted. [ 794.738413] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.738638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.751528] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.751767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.789362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.789362] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d635d2b-1797-4206-b032-b7450c1074bc is going to be deleted. [ 794.789734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.790054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.797243] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70dd2e08-5d3c-47df-8c82-524cc320dde0: rpc.has_security_group_logging(os_id): False [ 794.829246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.829796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.837385] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.837385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.841647] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.860450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.860621] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be deleted. [ 794.861684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.861925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.864693] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.864784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.873257] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.873257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.873257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.873557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.873557] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.873688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.873745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.873932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.874028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.874085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.874443] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.874619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.877316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.877316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.877467] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.877550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.877609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.878391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.878391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.878391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.878391] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.879699] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.881015] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.881442] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.881541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.881585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.881761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.881933] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.881995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.882785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.882940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.883047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.883134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.883293] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.883386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.883460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.883817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.883817] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.883918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.883918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.884049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.884120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.884200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.884292] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.887163] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f46ad058-cb41-404b-863c-078d919d7dec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.962904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.964594] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3153bb13-485b-4639-83ed-2a27b9bcedf0 is going to be deleted. [ 794.965964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.966308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.002792] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.003079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.019192] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.019192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.070297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.072481] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b723f584-c976-4351-bfcd-6ca761e670dd is going to be deleted. [ 795.072481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.072481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.081127] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.081306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.117648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.117648] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7554444-3d48-4fef-b5ad-54687b70bfc1 is going to be deleted. [ 795.117648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.117648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.122673] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2f62cb3-f405-432b-9d8c-8c08ea54e240 with status ACTIVE [ 795.123032] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.123397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.123397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.123632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.123776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.124084] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.124241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.124344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.124643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.124929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.125253] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.125958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.125958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.125958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.125958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.126310] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2f62cb3-f405-432b-9d8c-8c08ea54e240 is going to be updated. [ 795.154116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.154116] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a79ba361-9edb-4b9b-82c4-afa586cb4427 is going to be deleted. [ 795.154116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.154116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.154116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.154116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae9364a2-033c-455a-b65c-755fec76be27" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.154116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.154116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.154116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.154116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6981999-a42c-4650-befd-1111c3f609ec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.154116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.155338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.155338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.155338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2b03ac3-37c4-4e87-91a0-aaa294062815" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.155338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.155338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.155338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.155338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73e434cf-a3e8-49df-8050-fa1d2489f7dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.155338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.155338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.161564] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.161564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.179664] env[62909]: INFO networking_nsxv3.common.synchronization [None req-78891f67-ae9f-4bc4-bf38-3e1aeaa4f90c None None] Enqueued Resource ID: a859a883-41e3-442e-b413-dd4d9531689d with Priority: HIGHEST for action port [ 795.179664] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a859a883-41e3-442e-b413-dd4d9531689d with Priority: HIGHEST for action port [ 795.180307] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-a859a883-41e3-442e-b413-dd4d9531689d taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.180460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a859a883-41e3-442e-b413-dd4d9531689d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.180494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a859a883-41e3-442e-b413-dd4d9531689d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.180738] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a859a883-41e3-442e-b413-dd4d9531689d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.180814] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a859a883-41e3-442e-b413-dd4d9531689d',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.211562] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.211648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.211648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.211848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.211982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.216105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2f62cb3-f405-432b-9d8c-8c08ea54e240" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.219127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.219441] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.219536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.219602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.219794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.219874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.219990] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 is going to be updated. [ 795.221194] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.221412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.221453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.221563] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe2d83f4-67d0-4b35-90a2-f919bc3f65bb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.221690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.221828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.221900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.222044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35857353-01c5-40e5-800e-946a46ca0fc9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.222192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.222328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.222398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.222501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d635d2b-1797-4206-b032-b7450c1074bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.222606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.222735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.226017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.226017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.226017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.226017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.226017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.226017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3153bb13-485b-4639-83ed-2a27b9bcedf0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.269967] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.269967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.269967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.269967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.269967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.269967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b723f584-c976-4351-bfcd-6ca761e670dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.282052] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.282207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.282283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.282491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.282569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.282691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7554444-3d48-4fef-b5ad-54687b70bfc1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.347259] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e414027f-367d-4f4e-abad-e74bd2a6a762: rpc.has_security_group_logging(os_id): False [ 795.350637] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.350794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.350852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.351128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.351227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.351355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a79ba361-9edb-4b9b-82c4-afa586cb4427" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.391066] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57568fd4-ee2b-43e3-a228-9a168490f0f5: rpc.has_security_group_logging(os_id): False [ 795.391066] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.391066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.391066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.391066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.391066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.391066] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 is going to be updated. [ 795.392594] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf1c820f-c032-491e-a171-042f82234545: rpc.has_security_group_logging(os_id): False [ 795.393843] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23297eee-5815-4160-b6ed-90818fa0ab3a: rpc.has_security_group_logging(os_id): False [ 795.395160] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.395437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.395594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.395872] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.396066] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.396269] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46ad058-cb41-404b-863c-078d919d7dec is going to be created. [ 795.428805] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.429022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.429022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.429352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.448436] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.448680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.461374] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.461962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.463939] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.464093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.489165] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.489319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.495764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.496480] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.496614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.496614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.496806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.496974] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.497064] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e414027f-367d-4f4e-abad-e74bd2a6a762 is going to be updated. [ 795.498376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.498577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.498723] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.499705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.499921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.519739] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.519945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.520043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.520278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.520447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.523486] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.524263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.524263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.524263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.524263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.567299] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 in Status: IN_PROGRESS for 2s [ 795.575184] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: IN_PROGRESS for 2s [ 795.579128] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46ad058-cb41-404b-863c-078d919d7dec in Status: UNINITIALIZED for 2s [ 795.604749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.604749] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.604985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.605960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.606280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.606421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.607363] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 795.607816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.612311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.667356] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.667511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.671312] env[62909]: INFO networking_nsxv3.common.synchronization [req-59765cbb-0bec-4b54-a3f7-e89b47d4ac1f req-3cb8b865-c61c-4924-9cf1-0e6a1f2a2c55 tempest-ListServerFiltersTestJSON-403224292 tempest-ListServerFiltersTestJSON-403224292-project-member] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 795.671312] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 795.671532] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.672929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.672929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.672929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.672929] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.672929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.672929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.672929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.672929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.672929] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.680364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.680364] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.680364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.680364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.680364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.680364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.680364] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.680833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.680833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.680833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.681042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.681390] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.681390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.681390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.684018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.684018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.684018] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 795.684018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.684018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.687088] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a859a883-41e3-442e-b413-dd4d9531689d [ 795.687303] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.687517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.687517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.689147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.689147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.689147] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a859a883-41e3-442e-b413-dd4d9531689d already deleted. [ 795.689147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a859a883-41e3-442e-b413-dd4d9531689d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.740015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.740015] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.740015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.740015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.740015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.740015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.740015] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.740015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.740386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.740386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.740386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.740499] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.740552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.740589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.740707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.740774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.743182] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be updated. [ 795.744560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.744875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.744960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.772247] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e414027f-367d-4f4e-abad-e74bd2a6a762 in Status: IN_PROGRESS for 2s [ 795.786244] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.786244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.786244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.786561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.786561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.812576] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 795.835313] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.835484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.835524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.835716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.835861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.875965] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 795.904040] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 795.904040] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.904040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.904040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.904040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.904040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.933459] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 796.177350] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.332476] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-654 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.332476] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.332476] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.332476] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.332803] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.333080] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.333080] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.336155] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.336155] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.336155] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.336155] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.336155] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.336155] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.336155] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.336155] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.336155] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.364124] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.364246] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.364388] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.364570] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-654" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.365042] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.365290] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.365290] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.365580] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.365660] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.679805] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.870730] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.871072] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.871149] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.871421] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.871571] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.871729] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5 not found, creating... [ 796.871987] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.872160] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.872281] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.872503] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.872641] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.872949] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.873099] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.873216] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.873423] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.873547] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.873687] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5 is going to be created. [ 796.896217] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.898125] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.898125] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.898125] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.898125] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.898125] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.182392] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.182567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.182642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.182896] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.183062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.183134] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be updated. [ 797.219104] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.219104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.219104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.219104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.219104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.228846] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 797.534339] env[62909]: INFO networking_nsxv3.common.synchronization [None req-c9d19236-b73a-40b4-8151-771339a44aec tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_rules [ 797.534339] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_rules [ 797.534339] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.534339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.534339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.534339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.535142] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.588684] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46ad058-cb41-404b-863c-078d919d7dec in Status: SUCCESS [ 797.588922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.589186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.589420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.589647] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.589769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.589836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.590096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.590223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.590332] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46ad058-cb41-404b-863c-078d919d7dec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.592537] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: SUCCESS [ 797.592716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.592884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.593104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.593305] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.593415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.593482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.593791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.593873] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.594097] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.596457] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 in Status: SUCCESS [ 797.596657] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.791715] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e414027f-367d-4f4e-abad-e74bd2a6a762 in Status: SUCCESS [ 797.791897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.826034] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 797.826218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.828650] env[62909]: INFO networking_nsxv3.common.synchronization [None req-0cd60222-2574-4b94-9e53-87a1a471fa0c tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_rules [ 797.829284] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_rules [ 797.829658] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.829805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.893267] env[62909]: INFO networking_nsxv3.common.synchronization [req-59765cbb-0bec-4b54-a3f7-e89b47d4ac1f req-75458b8e-3d5d-4f9b-bc4c-ca8372e61826 service nova] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_rules [ 797.893521] env[62909]: INFO networking_nsxv3.common.synchronization [req-59765cbb-0bec-4b54-a3f7-e89b47d4ac1f req-75458b8e-3d5d-4f9b-bc4c-ca8372e61826 service nova] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 797.893661] env[62909]: INFO networking_nsxv3.common.synchronization [req-59765cbb-0bec-4b54-a3f7-e89b47d4ac1f req-75458b8e-3d5d-4f9b-bc4c-ca8372e61826 service nova] Enqueued Resource ID: 141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5 with Priority: HIGHEST for action port [ 797.896943] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_rules [ 797.896943] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 797.896943] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5 with Priority: HIGHEST for action port [ 797.896943] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 797.897336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.897539] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.897636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.897840] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.897918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.900947] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.901412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.901412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.901412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.901412] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.951826] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 797.951826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.951826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.951826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.951826] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.054210] env[62909]: INFO networking_nsxv3.common.synchronization [None req-cd038c81-7a6b-4876-b774-aa2e2ce609a1 None None] Enqueued Resource ID: 1a00cbb2-df73-4c9c-b923-b6677fbe9004 with Priority: HIGHEST for action port [ 798.054715] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a00cbb2-df73-4c9c-b923-b6677fbe9004 with Priority: HIGHEST for action port [ 798.055116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a00cbb2-df73-4c9c-b923-b6677fbe9004 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.055193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a00cbb2-df73-4c9c-b923-b6677fbe9004" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.055259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a00cbb2-df73-4c9c-b923-b6677fbe9004" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.055602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a00cbb2-df73-4c9c-b923-b6677fbe9004" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.055602] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a00cbb2-df73-4c9c-b923-b6677fbe9004',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.059510] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.059685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.059784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.060126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.060126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.060229] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a05b8610-e099-492a-a795-e90ed01da010 already deleted. [ 798.060276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.060409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.060569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.060650] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.096877] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.097134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.097134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.100246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.100246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.100246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.100246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.100246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.100246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.100246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.100246] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46ad058-cb41-404b-863c-078d919d7dec is going to be deleted. [ 798.100246] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.159183] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.159323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.159391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.159610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.159705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.159808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.163766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.166203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.166203] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.166203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.166203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.166203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.166203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.166203] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46ad058-cb41-404b-863c-078d919d7dec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.403724] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5 with status ACTIVE [ 798.403957] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.404142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.404183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.404377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.404460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.405397] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.405397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.405397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.405397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.405397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.406302] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.406664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.406664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.406772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.406849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.406948] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5 is going to be updated. [ 798.432993] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.432993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.432993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.432993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.432993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.432993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-141c4f39-6bf0-48ce-b82e-4a8d6a3a0cb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.452866] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.453659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.558147] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a00cbb2-df73-4c9c-b923-b6677fbe9004 [ 798.558531] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.559415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.559415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.559415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.559415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.559415] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a00cbb2-df73-4c9c-b923-b6677fbe9004 already deleted. [ 798.559415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a00cbb2-df73-4c9c-b923-b6677fbe9004" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.593372] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.593372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.593584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.593775] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.593930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.593969] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a05b8610-e099-492a-a795-e90ed01da010 already deleted. [ 798.594350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.603077] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.667255] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.667623] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.667623] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.667623] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.667739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.668374] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.668374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.668374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.668374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.668374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.668877] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46ad058-cb41-404b-863c-078d919d7dec already deleted. [ 798.668877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.668877] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f46ad058-cb41-404b-863c-078d919d7dec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.669979] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.670428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.670428] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.670428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.670568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.670568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.670631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.670720] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46ad058-cb41-404b-863c-078d919d7dec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.109642] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.110032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.110032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.110270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.110404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.110546] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 is going to be updated. [ 799.144250] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.145086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.145086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.145328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.145550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.156516] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: IN_PROGRESS for 2s [ 799.173098] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.173383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.173470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.173772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.173772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.173976] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.174112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.174171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.174300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.174378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.174460] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46ad058-cb41-404b-863c-078d919d7dec already deleted. [ 799.174539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.174738] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f46ad058-cb41-404b-863c-078d919d7dec',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.240329] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 799.240529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.240650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.241213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.241213] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.241213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.242143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.242143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.242143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.242143] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.371241] env[62909]: INFO networking_nsxv3.common.synchronization [req-89858354-36d9-4ee8-9b27-39786fdacfd8 req-355c8833-4f78-47dc-8a10-c1ad5e8a41c7 tempest-ImagesTestJSON-652168268 tempest-ImagesTestJSON-652168268-project-member] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 799.371241] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 799.371462] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.371701] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.371860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.372169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.372520] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.372761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.372913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.373174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.373354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.373538] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.680381] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f46ad058-cb41-404b-863c-078d919d7dec: rpc.has_security_group_logging(os_id): False [ 799.699785] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.699785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.699785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.700153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.700153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.700628] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.700628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.700628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.700628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.700821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.700821] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f46ad058-cb41-404b-863c-078d919d7dec is going to be created. [ 799.722107] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f46ad058-cb41-404b-863c-078d919d7dec], does not exist path=[/infra/domains/default/groups/f46ad058-cb41-404b-863c-078d919d7dec]."\n}' [ 799.722386] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f46ad058-cb41-404b-863c-078d919d7dec failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f46ad058-cb41-404b-863c-078d919d7dec [ 799.722386] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 799.744048] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.760233] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.760443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.760549] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.761373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.761492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.761705] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.761819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.761883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.762026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.762110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.762396] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.762396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.762525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.762583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.762655] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.762738] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f46ad058-cb41-404b-863c-078d919d7dec is going to be created. [ 799.776188] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.776399] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.776768] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.776902] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.777051] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.777216] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.777335] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.777550] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.777694] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.777904] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.778038] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.778156] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.778264] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.778377] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.778485] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.778623] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.782844] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f46ad058-cb41-404b-863c-078d919d7dec], does not exist path=[/infra/domains/default/groups/f46ad058-cb41-404b-863c-078d919d7dec]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f46ad058-cb41-404b-863c-078d919d7dec [ 799.783039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f46ad058-cb41-404b-863c-078d919d7dec" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.784219] env[62909]: Traceback (most recent call last): [ 799.784219] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 799.784219] env[62909]: return func(*args, **kwargs) [ 799.784219] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 799.784219] env[62909]: res.raise_for_status() [ 799.784219] env[62909]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 799.784219] env[62909]: raise HTTPError(http_error_msg, response=self) [ 799.784219] env[62909]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f46ad058-cb41-404b-863c-078d919d7dec [ 799.784219] env[62909]: During handling of the above exception, another exception occurred: [ 799.784219] env[62909]: Traceback (most recent call last): [ 799.784219] env[62909]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 799.784219] env[62909]: listener.cb(fileno) [ 799.784219] env[62909]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 265, in main [ 799.784219] env[62909]: result = function(*args, **kwargs) [ 799.784219] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 799.784219] env[62909]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 799.784219] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 799.784219] env[62909]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 799.784219] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 799.784219] env[62909]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 799.784219] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 799.784219] env[62909]: res.raise_for_status() [ 799.784219] env[62909]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 799.784219] env[62909]: raise HTTPError(http_error_msg, response=self) [ 799.784219] env[62909]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f46ad058-cb41-404b-863c-078d919d7dec [ 799.784219] env[62909]: Removing descriptor: 63 [ 799.800599] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.800757] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.800915] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.801139] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.802075] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-7df887d7-caf7-4a91-b3f6-2476e768b7c2 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.802075] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-7df887d7-caf7-4a91-b3f6-2476e768b7c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.802075] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-7df887d7-caf7-4a91-b3f6-2476e768b7c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.802075] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-7df887d7-caf7-4a91-b3f6-2476e768b7c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.802253] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7df887d7-caf7-4a91-b3f6-2476e768b7c2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.876996] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.877253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.877354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.877688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.902478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.902762] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.902886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.902946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.903177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.903261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.903349] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 799.928280] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.928280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.928463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.928501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.929424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.938051] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 800.250448] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.304464] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.304723] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.304852] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.305264] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.305432] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.305523] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 7df887d7-caf7-4a91-b3f6-2476e768b7c2 not found, creating... [ 800.306311] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.306311] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.306311] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.306507] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.306507] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.307113] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.307305] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.307427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.307642] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.307773] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.307926] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 7df887d7-caf7-4a91-b3f6-2476e768b7c2 is going to be created. [ 800.330910] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.332416] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.332416] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.332416] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.332416] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.332656] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-7df887d7-caf7-4a91-b3f6-2476e768b7c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.757703] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.757917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.757985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.758195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.758249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.758350] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be updated. [ 800.787242] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.787879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.787973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.788319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.788424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.801371] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 801.168560] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: SUCCESS [ 801.168560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.168560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.168560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.168560] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.168560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.168560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.168560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.168560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.168560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.168560] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.169663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.171152] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.171152] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.171152] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.171152] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.171782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.171960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.172084] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.359081] env[62909]: INFO networking_nsxv3.common.synchronization [req-89858354-36d9-4ee8-9b27-39786fdacfd8 req-df71aaaa-d55f-4153-8213-e5ac3789a6dc service nova] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_rules [ 801.359081] env[62909]: INFO networking_nsxv3.common.synchronization [req-89858354-36d9-4ee8-9b27-39786fdacfd8 req-df71aaaa-d55f-4153-8213-e5ac3789a6dc service nova] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 801.359081] env[62909]: INFO networking_nsxv3.common.synchronization [req-89858354-36d9-4ee8-9b27-39786fdacfd8 req-df71aaaa-d55f-4153-8213-e5ac3789a6dc service nova] Enqueued Resource ID: 7df887d7-caf7-4a91-b3f6-2476e768b7c2 with Priority: HIGHEST for action port [ 801.359081] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_rules [ 801.359081] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 801.359081] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7df887d7-caf7-4a91-b3f6-2476e768b7c2 with Priority: HIGHEST for action port [ 801.360325] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.360643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.360869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.361216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.362497] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.364794] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.364794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.364794] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-7df887d7-caf7-4a91-b3f6-2476e768b7c2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.364794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7df887d7-caf7-4a91-b3f6-2476e768b7c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.364794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7df887d7-caf7-4a91-b3f6-2476e768b7c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.364794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7df887d7-caf7-4a91-b3f6-2476e768b7c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.364794] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7df887d7-caf7-4a91-b3f6-2476e768b7c2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.676690] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.676972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.677136] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.867537] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.867815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.868011] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7df887d7-caf7-4a91-b3f6-2476e768b7c2 with status ACTIVE [ 801.868276] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.868420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.868489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.868831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.868949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.869183] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.869270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.869357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.869586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.869694] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.869901] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.873703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.873807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.873992] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.874096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.874202] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7df887d7-caf7-4a91-b3f6-2476e768b7c2 is going to be updated. [ 801.898237] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.898237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.898237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.898237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.898237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.898237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7df887d7-caf7-4a91-b3f6-2476e768b7c2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.956656] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 801.956656] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa deletion is rescheduled due to dependency. [ 801.956656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.956656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.956656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.956656] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.956656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.956656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.956656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.956656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.956656] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.018062] env[62909]: INFO networking_nsxv3.common.synchronization [None req-70efc7e2-62fc-4e48-95cc-54fe4fe91ccb None None] Enqueued Resource ID: 0c63d76b-ce5f-4276-a39e-e7a7190ac236 with Priority: HIGHEST for action port [ 802.018062] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c63d76b-ce5f-4276-a39e-e7a7190ac236 with Priority: HIGHEST for action port [ 802.018062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c63d76b-ce5f-4276-a39e-e7a7190ac236 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.018062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c63d76b-ce5f-4276-a39e-e7a7190ac236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.018062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c63d76b-ce5f-4276-a39e-e7a7190ac236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.018062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c63d76b-ce5f-4276-a39e-e7a7190ac236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.018062] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c63d76b-ce5f-4276-a39e-e7a7190ac236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.179281] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.461751] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.522847] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c63d76b-ce5f-4276-a39e-e7a7190ac236 [ 802.522847] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.522847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.522847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.522847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.522847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.522847] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c63d76b-ce5f-4276-a39e-e7a7190ac236 already deleted. [ 802.522847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c63d76b-ce5f-4276-a39e-e7a7190ac236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.686621] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.687324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.687324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.687324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.687324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.687713] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 is going to be updated. [ 802.731221] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.731711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.731785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.732032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.732183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.746015] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: IN_PROGRESS for 2s [ 802.810692] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 802.811210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.811558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.811902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.812270] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.812565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.812754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.813390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.813622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.814162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.814435] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.964462] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.046349] env[62909]: INFO networking_nsxv3.common.synchronization [req-2f2f42e1-02e7-4a6c-bd75-fa16b3ea66f1 req-4d886150-38d9-471a-8005-91e1e207c17e tempest-ServersV294TestFqdnHostnames-1806071593 tempest-ServersV294TestFqdnHostnames-1806071593-project-member] Enqueued Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_members [ 803.047995] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d35f16-322f-4fce-8671-2c59aba9257f with Priority: HIGHEST for action security_group_members [ 803.048885] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d35f16-322f-4fce-8671-2c59aba9257f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.048885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.048885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.049165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.049165] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.049380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.049380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.049901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.049901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.049901] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d35f16-322f-4fce-8671-2c59aba9257f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.320079] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.320272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.320343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.320573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.320742] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.320850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.320897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.321109] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.321171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.321256] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.321406] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.321500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.321561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.321702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.321895] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.321948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.321983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.322125] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.322198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.322382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.322483] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.466568] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.469908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.469908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.469908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.469908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.469908] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 803.506027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.506027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.506027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.506027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.506027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.515306] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 803.557026] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.557026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.557026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.557026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.590869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.591412] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.591412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.591412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.591711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.591841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.592031] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d35f16-322f-4fce-8671-2c59aba9257f is going to be updated. [ 803.640389] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.642630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.642630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.642630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.642630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.652983] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d35f16-322f-4fce-8671-2c59aba9257f in Status: IN_PROGRESS for 2s [ 803.824768] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf1c820f-c032-491e-a171-042f82234545: rpc.has_security_group_logging(os_id): False [ 803.845325] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.845464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.845521] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.845735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.866316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.866676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.866676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.866789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.867333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.867333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.867333] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.867333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.867333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.868192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.868192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.868192] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.868192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.868192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.868192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.868192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.868192] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be updated. [ 803.935914] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.935914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.935914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.935914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.935914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.955798] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 804.755578] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: SUCCESS [ 804.755834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.756615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.756615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.756615] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.756615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.756615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.756916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.756916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.756916] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.760226] env[62909]: INFO networking_nsxv3.common.synchronization [req-7303ec4b-6e46-4dd2-8fb1-684f0485cc66 req-28bf8fed-3e08-4428-98d5-7346629583f5 tempest-ServerAddressesTestJSON-1238269399 tempest-ServerAddressesTestJSON-1238269399-project-member] Enqueued Resource ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 with Priority: HIGHEST for action security_group_members [ 804.760697] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 with Priority: HIGHEST for action security_group_members [ 804.761129] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-732ce2ac-f7fb-41f5-ac97-eceb113118d9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.761202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.761240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.761451] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.761606] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.761704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.761764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.761967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.762024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.762265] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('732ce2ac-f7fb-41f5-ac97-eceb113118d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.972750] env[62909]: INFO networking_nsxv3.common.synchronization [None req-65f62d60-e2fa-4948-8798-7522c50561e9 None None] Enqueued Resource ID: fb85c6da-54be-49e1-8550-c02e80c4477b with Priority: HIGHEST for action port [ 804.974045] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb85c6da-54be-49e1-8550-c02e80c4477b with Priority: HIGHEST for action port [ 804.977941] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb85c6da-54be-49e1-8550-c02e80c4477b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.977941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb85c6da-54be-49e1-8550-c02e80c4477b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.977941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb85c6da-54be-49e1-8550-c02e80c4477b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.977941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb85c6da-54be-49e1-8550-c02e80c4477b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.977941] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb85c6da-54be-49e1-8550-c02e80c4477b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.157518] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-598 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.157741] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-598" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.157900] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-598" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.158572] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-598" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.158572] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.158732] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.158817] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.160310] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.160731] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.160829] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.160887] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.161237] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.161442] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.161590] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.161710] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.161851] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.185036] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.185304] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.185453] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.185627] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-598" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.185942] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-3d606e37-edb2-4b01-b58d-acec974dda62 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.186139] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-3d606e37-edb2-4b01-b58d-acec974dda62" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.186315] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-3d606e37-edb2-4b01-b58d-acec974dda62" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.186575] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-3d606e37-edb2-4b01-b58d-acec974dda62" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.186714] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d606e37-edb2-4b01-b58d-acec974dda62',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.259354] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.265495] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.265495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.265495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.265495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.265495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.265495] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.265495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.265495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.265495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.265495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.265495] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 already deleted. [ 805.265495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.480269] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb85c6da-54be-49e1-8550-c02e80c4477b [ 805.480584] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.480740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.480834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.481120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.481340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.481457] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb85c6da-54be-49e1-8550-c02e80c4477b already deleted. [ 805.481548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb85c6da-54be-49e1-8550-c02e80c4477b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.528912] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 805.529278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.529489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.529721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.531225] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.531225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.531225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.531225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.531225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.531225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.531225] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.667029] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d35f16-322f-4fce-8671-2c59aba9257f in Status: SUCCESS [ 805.667232] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d35f16-322f-4fce-8671-2c59aba9257f deletion is rescheduled due to dependency. [ 805.667278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d35f16-322f-4fce-8671-2c59aba9257f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.690887] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.691186] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.691444] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.691749] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.691923] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.692126] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 3d606e37-edb2-4b01-b58d-acec974dda62 not found, creating... [ 805.693320] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.693320] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.693320] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.693320] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.693661] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.694601] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.694601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.694601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.694601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.694847] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.694883] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 3d606e37-edb2-4b01-b58d-acec974dda62 is going to be created. [ 805.723180] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.723180] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.723180] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.723180] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.723180] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.724596] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-3d606e37-edb2-4b01-b58d-acec974dda62" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.764423] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.976154] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 805.976470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.034534] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.034707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.034754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.034978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.035162] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.035266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.035329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.036047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.036047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.036047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.036047] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.036047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.036047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.036047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.036440] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.036440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.036440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.036440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.036602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.036602] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.036673] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.268517] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.268678] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.268748] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.268957] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.269062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.269154] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 is going to be updated. [ 806.299226] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.299419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.299487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.299639] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.299776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.309406] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: IN_PROGRESS for 2s [ 806.539157] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 828a3fee-5001-4141-bcfb-64c185ab0efa: rpc.has_security_group_logging(os_id): False [ 806.562242] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.562476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.562476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.562737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.562835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.563420] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.563420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.563420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.563844] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.563844] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.563844] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.563844] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.564566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.565609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.565609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.565772] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.566052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.566052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.566531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.566531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.566531] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 806.586665] env[62909]: INFO networking_nsxv3.common.synchronization [req-7303ec4b-6e46-4dd2-8fb1-684f0485cc66 req-29c20278-a1ce-4190-8621-01466d854a94 service nova] Enqueued Resource ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 with Priority: HIGHEST for action security_group_rules [ 806.587032] env[62909]: INFO networking_nsxv3.common.synchronization [req-7303ec4b-6e46-4dd2-8fb1-684f0485cc66 req-29c20278-a1ce-4190-8621-01466d854a94 service nova] Enqueued Resource ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 with Priority: HIGHEST for action security_group_members [ 806.587032] env[62909]: INFO networking_nsxv3.common.synchronization [req-7303ec4b-6e46-4dd2-8fb1-684f0485cc66 req-29c20278-a1ce-4190-8621-01466d854a94 service nova] Enqueued Resource ID: 3d606e37-edb2-4b01-b58d-acec974dda62 with Priority: HIGHEST for action port [ 806.587589] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 with Priority: HIGHEST for action security_group_rules [ 806.587726] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 with Priority: HIGHEST for action security_group_members [ 806.587822] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d606e37-edb2-4b01-b58d-acec974dda62 with Priority: HIGHEST for action port [ 806.588314] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-732ce2ac-f7fb-41f5-ac97-eceb113118d9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.588442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.588514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.588803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.588885] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('732ce2ac-f7fb-41f5-ac97-eceb113118d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.590169] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-732ce2ac-f7fb-41f5-ac97-eceb113118d9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.590382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.590382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.590508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.590690] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.590924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.590924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.591029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.591120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.591218] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('732ce2ac-f7fb-41f5-ac97-eceb113118d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.592972] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d606e37-edb2-4b01-b58d-acec974dda62 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.593409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d606e37-edb2-4b01-b58d-acec974dda62" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.593409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d606e37-edb2-4b01-b58d-acec974dda62" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.593640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d606e37-edb2-4b01-b58d-acec974dda62" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.593768] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d606e37-edb2-4b01-b58d-acec974dda62',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.670733] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.670966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.670966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.672163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.672163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.694567] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 807.042461] env[62909]: INFO networking_nsxv3.common.synchronization [req-3d6a8449-0313-4833-98c7-2904697fbd3a req-3f5cda5b-be5b-4458-b4d9-df4f2421d42d tempest-ServerRescueTestJSONUnderV235-1448321267 tempest-ServerRescueTestJSONUnderV235-1448321267-project-member] Enqueued Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 807.043026] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 with Priority: HIGHEST for action security_group_members [ 807.043347] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.043448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.095701] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('732ce2ac-f7fb-41f5-ac97-eceb113118d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.096677] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-732ce2ac-f7fb-41f5-ac97-eceb113118d9 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.096791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.096973] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d606e37-edb2-4b01-b58d-acec974dda62 with status ACTIVE [ 807.097148] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.097279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.097321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.097613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.097613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.097763] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.097834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.097900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.098074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.100357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.100622] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.100722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.100804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.100951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.101091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.101143] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d606e37-edb2-4b01-b58d-acec974dda62 is going to be updated. [ 807.128292] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.128457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.128524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.128708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.128858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.129037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d606e37-edb2-4b01-b58d-acec974dda62" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.604076] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('732ce2ac-f7fb-41f5-ac97-eceb113118d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.108246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.108246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.109126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.109126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.109126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.109126] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 is going to be created. [ 808.140032] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.140032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.140032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.140032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.140032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.150134] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 in Status: UNINITIALIZED for 2s [ 808.331028] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: SUCCESS [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.331028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.331028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b422f-c1c0-41cd-91df-fa408193f5a3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.331028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.331028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.332893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.336023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.336023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.336023] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.336023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.336023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.336023] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.336023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.336023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.336023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.336023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.336023] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.711814] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 808.712128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.838035] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7b422f-c1c0-41cd-91df-fa408193f5a3: rpc.has_security_group_logging(os_id): False [ 808.841337] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.841337] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.841337] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.841337] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.847697] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ca1927bd-1fb7-4fbc-baca-2979e7aeb3b0 None None] Enqueued Resource ID: 264531e7-cb02-43c4-b72e-1d9aa9805d7c with Priority: HIGHEST for action port [ 808.848341] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264531e7-cb02-43c4-b72e-1d9aa9805d7c with Priority: HIGHEST for action port [ 808.848987] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-264531e7-cb02-43c4-b72e-1d9aa9805d7c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.851026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-264531e7-cb02-43c4-b72e-1d9aa9805d7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.851026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-264531e7-cb02-43c4-b72e-1d9aa9805d7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.851026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-264531e7-cb02-43c4-b72e-1d9aa9805d7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.851026] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('264531e7-cb02-43c4-b72e-1d9aa9805d7c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.866814] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.867072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.872087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.872352] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.872501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.872566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.873346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.873346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.873346] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 is going to be updated. [ 808.874128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.874297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.874371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.874595] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.874884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.874884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.874884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.875069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.876223] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.876356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.876410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.876678] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.876678] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.876823] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.876928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.876928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.877078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.877145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.877233] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 is going to be updated. [ 808.912402] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.912402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.912402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.912402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.912402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.923653] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: IN_PROGRESS for 2s [ 808.957882] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.958094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.958178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.958529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.958735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.988587] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: IN_PROGRESS for 2s [ 809.354180] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 264531e7-cb02-43c4-b72e-1d9aa9805d7c [ 809.354416] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.354552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.354619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.354831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.354920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.355019] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:264531e7-cb02-43c4-b72e-1d9aa9805d7c already deleted. [ 809.355104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-264531e7-cb02-43c4-b72e-1d9aa9805d7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.159887] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 in Status: SUCCESS [ 810.160153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.160317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.160526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.160711] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.160823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.160889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.161098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.161231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.162112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.162112] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('732ce2ac-f7fb-41f5-ac97-eceb113118d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.664390] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-732ce2ac-f7fb-41f5-ac97-eceb113118d9 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.666732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.666732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.666732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.666732] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.666732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.666732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.666732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.666732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.666732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.666732] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-732ce2ac-f7fb-41f5-ac97-eceb113118d9 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.666732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.666732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.667162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.667162] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.667162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.667162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.667268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.667331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.667416] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.667506] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('732ce2ac-f7fb-41f5-ac97-eceb113118d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.767123] env[62909]: INFO networking_nsxv3.common.synchronization [None req-aa966a21-fa6b-4458-b477-884916636f9c tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_rules [ 810.767701] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_rules [ 810.768058] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.768192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.768263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.768548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.768631] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.854532] env[62909]: INFO networking_nsxv3.common.synchronization [None req-86c71e98-6b58-442d-abf3-1139a4121438 tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_rules [ 810.854999] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_rules [ 810.854999] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.859267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.937971] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: SUCCESS [ 810.937971] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 deletion is rescheduled due to dependency. [ 810.937971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.004990] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 in Status: SUCCESS [ 811.005303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.005552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.005802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.005891] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7b422f-c1c0-41cd-91df-fa408193f5a3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.170384] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 732ce2ac-f7fb-41f5-ac97-eceb113118d9: rpc.has_security_group_logging(os_id): False [ 811.190953] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.190953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.190953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.190953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.190953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.190953] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.190953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.190953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.190953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.190953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.190953] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.190953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.190953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.191711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.191711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.191711] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.191711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.191711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.191875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.191928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.193075] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 is going to be created. [ 811.262309] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.262449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.262504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.262707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.262879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.275275] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 in Status: IN_PROGRESS for 2s [ 811.290747] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.290911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.291048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.291219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.291307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.291403] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 already deleted. [ 811.291486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.292070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.296020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.296020] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.533724] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.533892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.533964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.534211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.534728] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.534728] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7b422f-c1c0-41cd-91df-fa408193f5a3 is going to be deleted. [ 811.613312] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.613557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.613557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.613751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.613869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.613962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7b422f-c1c0-41cd-91df-fa408193f5a3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.813172] env[62909]: INFO networking_nsxv3.common.synchronization [None req-0b6692fb-18e6-45f2-a553-4052ed7ed455 None None] Enqueued Resource ID: 6f56c8b8-7460-4a4e-8ef1-8f04adebac02 with Priority: HIGHEST for action port [ 811.813172] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f56c8b8-7460-4a4e-8ef1-8f04adebac02 with Priority: HIGHEST for action port [ 811.816353] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f56c8b8-7460-4a4e-8ef1-8f04adebac02 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.817258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f56c8b8-7460-4a4e-8ef1-8f04adebac02" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.817258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f56c8b8-7460-4a4e-8ef1-8f04adebac02" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.817258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f56c8b8-7460-4a4e-8ef1-8f04adebac02" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.817258] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f56c8b8-7460-4a4e-8ef1-8f04adebac02',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.822890] env[62909]: INFO networking_nsxv3.common.synchronization [req-01a208ef-5148-483c-bbf6-de294373a9f7 req-3a2e67b8-a0bc-452f-9366-eb31fe20ffeb tempest-AttachVolumeShelveTestJSON-1170767985 tempest-AttachVolumeShelveTestJSON-1170767985-project-member] Enqueued Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_members [ 811.825879] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.825879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.825879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.829274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.829274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.829274] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 already deleted. [ 811.829274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.829274] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_members [ 811.829800] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.829800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.829800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.830165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.830356] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.830516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.830562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.831174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.831174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.831174] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.329019] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f56c8b8-7460-4a4e-8ef1-8f04adebac02 [ 812.329428] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.329654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.329898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.330257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.330403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.330544] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f56c8b8-7460-4a4e-8ef1-8f04adebac02 already deleted. [ 812.330666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f56c8b8-7460-4a4e-8ef1-8f04adebac02" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.334416] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.334541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.334682] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.335057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.335168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.335383] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.335548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.335646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.335824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.335903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.335994] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d711f143-3c86-4518-9590-301f0739c6ea already deleted. [ 812.336090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.338677] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.338862] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.338987] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.339299] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.339631] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.339801] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.339919] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.340248] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.340381] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.340590] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.340703] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.340815] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.340923] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.341177] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.341319] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.341456] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.362229] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.362505] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.362680] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.362935] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.363277] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-c3221de3-00d5-45e7-af68-04297360fbcf taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.363464] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.363659] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.364056] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.364209] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3221de3-00d5-45e7-af68-04297360fbcf',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.867052] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.867432] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.867785] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.867785] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.867956] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.868149] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port c3221de3-00d5-45e7-af68-04297360fbcf not found, creating... [ 812.868512] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.868637] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.868685] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.868923] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.869109] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.869397] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.869894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.869894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.869990] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.870173] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.870495] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: c3221de3-00d5-45e7-af68-04297360fbcf is going to be created. [ 812.890213] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.890468] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.890572] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.890856] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.891129] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.891374] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.914512] env[62909]: INFO networking_nsxv3.common.synchronization [req-bd1b9022-c69f-41c1-9880-26bd3ad1b4c3 req-110b5a27-3e3d-49af-9e46-e7c4c70f2613 tempest-ServerRescueTestJSON-1768795781 tempest-ServerRescueTestJSON-1768795781-project-member] Enqueued Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 812.915774] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09a74b6-7c94-44f4-afba-b179607452eb with Priority: HIGHEST for action security_group_members [ 812.916272] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d09a74b6-7c94-44f4-afba-b179607452eb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.916478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.916600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.916877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.917114] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.917270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.917368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.917556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.917686] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.917819] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d09a74b6-7c94-44f4-afba-b179607452eb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.295692] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 in Status: SUCCESS [ 813.295874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.420141] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.420276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.420276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.420497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.443189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.443189] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.443189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.443189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.443189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.443189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.443189] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d09a74b6-7c94-44f4-afba-b179607452eb is going to be updated. [ 813.475311] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.475455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.475524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.475737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.475883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.484736] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: IN_PROGRESS for 2s [ 813.685761] env[62909]: INFO networking_nsxv3.common.synchronization [req-01a208ef-5148-483c-bbf6-de294373a9f7 req-6574a76d-f28e-43b5-b643-791af2c5e526 service nova] Enqueued Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_rules [ 813.686039] env[62909]: INFO networking_nsxv3.common.synchronization [req-01a208ef-5148-483c-bbf6-de294373a9f7 req-6574a76d-f28e-43b5-b643-791af2c5e526 service nova] Enqueued Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_members [ 813.686116] env[62909]: INFO networking_nsxv3.common.synchronization [req-01a208ef-5148-483c-bbf6-de294373a9f7 req-6574a76d-f28e-43b5-b643-791af2c5e526 service nova] Enqueued Resource ID: c3221de3-00d5-45e7-af68-04297360fbcf with Priority: HIGHEST for action port [ 813.686596] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_rules [ 813.686730] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_members [ 813.686827] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3221de3-00d5-45e7-af68-04297360fbcf with Priority: HIGHEST for action port [ 813.687435] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.687563] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.687632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.687830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.687936] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.689328] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.689398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.690393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.690393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.690393] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.690393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.690393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.690393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.690393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.690393] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.691449] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3221de3-00d5-45e7-af68-04297360fbcf taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.691449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.691449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.691449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.691630] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3221de3-00d5-45e7-af68-04297360fbcf',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.125157] env[62909]: INFO networking_nsxv3.common.synchronization [req-c5f9e8de-5f34-4fee-8040-bd38f96f3099 req-fd53fdbc-b374-4c49-8da0-39ffc5bf7fc5 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 814.125730] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 814.126298] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.126432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.126489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.126684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.126839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.126980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.127023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.127387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.127498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.127601] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.194625] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.195591] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.195591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.195728] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3221de3-00d5-45e7-af68-04297360fbcf with status ACTIVE [ 814.195771] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.195906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.196084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.196382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.196382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.196540] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.196635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.196719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.196842] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.196911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.197349] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.197499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.197545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.200525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.200525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.200525] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3221de3-00d5-45e7-af68-04297360fbcf is going to be updated. [ 814.220645] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.220790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.220860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.221071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.221222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.221378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.544330] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.544542] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.544671] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.544941] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.545222] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.545487] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.545487] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.545705] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.545847] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.546079] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.546201] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.546303] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.546413] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.546523] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.546630] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.546763] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.630315] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.630521] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.630624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.630909] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.635902] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.636092] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.089 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 814.636232] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.636490] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.636830] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-55d78b2e-b665-4a1c-84fe-47e02f937395 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.637064] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-55d78b2e-b665-4a1c-84fe-47e02f937395" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.637140] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-55d78b2e-b665-4a1c-84fe-47e02f937395" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.637481] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-55d78b2e-b665-4a1c-84fe-47e02f937395" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.637626] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55d78b2e-b665-4a1c-84fe-47e02f937395',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.664578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.664912] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.665094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.665199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.665448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.665554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.665669] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 814.694015] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.694184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.694250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.694473] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.694633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.700302] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.706359] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 815.139693] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.140047] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.140136] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.140433] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.140602] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.140761] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 55d78b2e-b665-4a1c-84fe-47e02f937395 not found, creating... [ 815.141051] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.141250] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.141391] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.141635] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.141798] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.142098] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.142259] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.142612] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.142923] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.143092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.143255] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 55d78b2e-b665-4a1c-84fe-47e02f937395 is going to be created. [ 815.163320] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.163561] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.163693] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.164113] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.164456] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.164746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-55d78b2e-b665-4a1c-84fe-47e02f937395" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.205942] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.206166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.206234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.206486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.206570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.206669] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d711f143-3c86-4518-9590-301f0739c6ea is going to be created. [ 815.230624] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.230762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.230822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.231046] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.231210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.252200] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d711f143-3c86-4518-9590-301f0739c6ea in Status: UNINITIALIZED for 2s [ 815.494720] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d09a74b6-7c94-44f4-afba-b179607452eb in Status: SUCCESS [ 815.494902] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d09a74b6-7c94-44f4-afba-b179607452eb deletion is rescheduled due to dependency. [ 815.495024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d09a74b6-7c94-44f4-afba-b179607452eb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.936239] env[62909]: INFO networking_nsxv3.common.synchronization [req-c5f9e8de-5f34-4fee-8040-bd38f96f3099 req-aae3a752-f141-4047-a855-85b6c04956fc service nova] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_rules [ 815.936239] env[62909]: INFO networking_nsxv3.common.synchronization [req-c5f9e8de-5f34-4fee-8040-bd38f96f3099 req-aae3a752-f141-4047-a855-85b6c04956fc service nova] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 815.936239] env[62909]: INFO networking_nsxv3.common.synchronization [req-c5f9e8de-5f34-4fee-8040-bd38f96f3099 req-aae3a752-f141-4047-a855-85b6c04956fc service nova] Enqueued Resource ID: 55d78b2e-b665-4a1c-84fe-47e02f937395 with Priority: HIGHEST for action port [ 815.936239] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_rules [ 815.936239] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 815.936239] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d78b2e-b665-4a1c-84fe-47e02f937395 with Priority: HIGHEST for action port [ 815.936239] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.936239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.936239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.936239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.936810] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.937691] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.941067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.941067] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-55d78b2e-b665-4a1c-84fe-47e02f937395 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.941067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55d78b2e-b665-4a1c-84fe-47e02f937395" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.941067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55d78b2e-b665-4a1c-84fe-47e02f937395" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.941067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55d78b2e-b665-4a1c-84fe-47e02f937395" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.941067] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55d78b2e-b665-4a1c-84fe-47e02f937395',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.440634] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.441183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.441183] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55d78b2e-b665-4a1c-84fe-47e02f937395 with status ACTIVE [ 816.441183] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.441337] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.441396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.441594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.441686] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.441869] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.441969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.442044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.442350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.442464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.442702] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.442850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.442921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.443882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.443882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.443882] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55d78b2e-b665-4a1c-84fe-47e02f937395 is going to be updated. [ 816.472401] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.472564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.472679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.472994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.473143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.473358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55d78b2e-b665-4a1c-84fe-47e02f937395" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.723105] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 816.724022] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 deletion is rescheduled due to dependency. [ 816.724022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.724022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.724022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.724022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.724280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.724382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.724533] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.724636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.724768] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.227468] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.263075] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d711f143-3c86-4518-9590-301f0739c6ea in Status: SUCCESS [ 817.263075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.263075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.263075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.263075] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.263075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.263075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.263075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.263075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.263075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.263075] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.730308] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.764711] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.232356] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.232579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.232579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.232793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.232879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.232990] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 818.262048] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.262305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.262434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.262729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.262968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.267610] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d711f143-3c86-4518-9590-301f0739c6ea: rpc.has_security_group_logging(os_id): False [ 818.273575] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 818.287531] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.288345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.288478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.288757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.288899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.289383] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.289383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.289383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.289656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.289773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.289897] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d711f143-3c86-4518-9590-301f0739c6ea is going to be created. [ 818.359553] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.359675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.359740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.359956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.360245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.373033] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d711f143-3c86-4518-9590-301f0739c6ea in Status: IN_PROGRESS for 2s [ 819.202923] env[62909]: INFO networking_nsxv3.common.synchronization [req-2e12bfa8-f465-4642-a0c5-24257aa43993 req-b3263dd6-3cf8-4541-99b3-e717514646b8 tempest-ServerPasswordTestJSON-2059654700 tempest-ServerPasswordTestJSON-2059654700-project-member] Enqueued Resource ID: 6b692d00-090d-4fca-8b85-19b077d9435b with Priority: HIGHEST for action security_group_members [ 819.206665] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b692d00-090d-4fca-8b85-19b077d9435b with Priority: HIGHEST for action security_group_members [ 819.211060] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b692d00-090d-4fca-8b85-19b077d9435b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.211060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.211060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.211060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.211060] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.211060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.211060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.211060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.211060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.211060] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b692d00-090d-4fca-8b85-19b077d9435b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.702027] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.702027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-484" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.702027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-484" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.702027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-484" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.702027] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.702027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.702027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.702988] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.703296] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.703625] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.703857] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.704075] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.704296] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.704539] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.704774] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.705033] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.712031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.712031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.712031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.712031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.712031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.712031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.712031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.712031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.712031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.712031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.712031] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b692d00-090d-4fca-8b85-19b077d9435b already deleted. [ 819.712031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.729204] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.730408] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 819.730408] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.730408] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-484" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.730408] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-fc0ce838-2709-475a-8c53-7dce16800b0d taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.730408] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-fc0ce838-2709-475a-8c53-7dce16800b0d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.730780] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-fc0ce838-2709-475a-8c53-7dce16800b0d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.730955] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-fc0ce838-2709-475a-8c53-7dce16800b0d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.731432] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc0ce838-2709-475a-8c53-7dce16800b0d',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.234121] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.234439] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.234493] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.234777] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.234947] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.235126] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port fc0ce838-2709-475a-8c53-7dce16800b0d not found, creating... [ 820.235484] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.235727] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.235727] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.235955] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.236109] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.236443] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.236597] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.236777] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.237049] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.237224] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.237350] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: fc0ce838-2709-475a-8c53-7dce16800b0d is going to be created. [ 820.263209] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.263463] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.263570] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.264065] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.264454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.264737] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-fc0ce838-2709-475a-8c53-7dce16800b0d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.285039] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 820.285275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.286524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.286828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.287030] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.287241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.287241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.287421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.287500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.287601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.287712] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.386172] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d711f143-3c86-4518-9590-301f0739c6ea in Status: SUCCESS [ 820.386539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.790810] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.791064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.791140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.791395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.791632] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.791757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.791865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.792123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.792297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.792441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.792631] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.792762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.792869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.793078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.793253] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.793366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.793807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.793807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.793807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.793999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.793999] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.172315] env[62909]: INFO networking_nsxv3.common.synchronization [req-2e12bfa8-f465-4642-a0c5-24257aa43993 req-5e2c870d-4a6b-486b-b499-412ed315099f service nova] Enqueued Resource ID: 6b692d00-090d-4fca-8b85-19b077d9435b with Priority: HIGHEST for action security_group_rules [ 821.172493] env[62909]: INFO networking_nsxv3.common.synchronization [req-2e12bfa8-f465-4642-a0c5-24257aa43993 req-5e2c870d-4a6b-486b-b499-412ed315099f service nova] Enqueued Resource ID: 6b692d00-090d-4fca-8b85-19b077d9435b with Priority: HIGHEST for action security_group_members [ 821.172633] env[62909]: INFO networking_nsxv3.common.synchronization [req-2e12bfa8-f465-4642-a0c5-24257aa43993 req-5e2c870d-4a6b-486b-b499-412ed315099f service nova] Enqueued Resource ID: fc0ce838-2709-475a-8c53-7dce16800b0d with Priority: HIGHEST for action port [ 821.173464] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b692d00-090d-4fca-8b85-19b077d9435b with Priority: HIGHEST for action security_group_rules [ 821.173654] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b692d00-090d-4fca-8b85-19b077d9435b with Priority: HIGHEST for action security_group_members [ 821.173744] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0ce838-2709-475a-8c53-7dce16800b0d with Priority: HIGHEST for action port [ 821.174055] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b692d00-090d-4fca-8b85-19b077d9435b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.174174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.174240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.175217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.175289] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b692d00-090d-4fca-8b85-19b077d9435b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.176249] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b692d00-090d-4fca-8b85-19b077d9435b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.176390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.176538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.177080] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.178018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.178018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.178018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.178018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.178018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.178018] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b692d00-090d-4fca-8b85-19b077d9435b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.178798] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc0ce838-2709-475a-8c53-7dce16800b0d taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.178798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc0ce838-2709-475a-8c53-7dce16800b0d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.178798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc0ce838-2709-475a-8c53-7dce16800b0d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.178959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc0ce838-2709-475a-8c53-7dce16800b0d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.179047] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc0ce838-2709-475a-8c53-7dce16800b0d',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.298414] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e66bfb9-974f-43a6-93f8-54f17b7d81b3: rpc.has_security_group_logging(os_id): False [ 821.319021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.319021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.319021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.319021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.319767] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.319767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.319767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.320083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.320268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.320492] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 821.396162] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.396162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.396162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.396162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.396162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.408117] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 821.681054] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b692d00-090d-4fca-8b85-19b077d9435b taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.681257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.681542] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b692d00-090d-4fca-8b85-19b077d9435b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.683252] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc0ce838-2709-475a-8c53-7dce16800b0d with status ACTIVE [ 821.683494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.683646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.683719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.683974] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.684111] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.684354] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.684464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.684557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.684772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.684876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.685161] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.686668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.686668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.686668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.686668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.686668] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc0ce838-2709-475a-8c53-7dce16800b0d is going to be updated. [ 821.714433] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.714662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.714783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.715049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.715295] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.715535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc0ce838-2709-475a-8c53-7dce16800b0d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.938123] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e3cb63f9-f5d8-41a1-9924-7f66bc010001 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 821.938123] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 821.938732] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.939816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.940030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.940521] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.940830] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.941125] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.941378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.944084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.944084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.944084] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.193188] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b692d00-090d-4fca-8b85-19b077d9435b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.450157] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.572955] env[62909]: INFO networking_nsxv3.common.synchronization [req-3323ba41-b6f4-4ff7-a6f6-eee1a763a9ad req-5780121c-15de-4f5c-a0e1-e2e88279431e tempest-ServerAddressesTestJSON-1238269399 tempest-ServerAddressesTestJSON-1238269399-project-member] Enqueued Resource ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 with Priority: HIGHEST for action security_group_members [ 822.574437] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 with Priority: HIGHEST for action security_group_members [ 822.575258] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-732ce2ac-f7fb-41f5-ac97-eceb113118d9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.576544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.576728] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.577592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.577855] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.578116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.578291] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.578716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.578978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.579264] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('732ce2ac-f7fb-41f5-ac97-eceb113118d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.699401] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.699401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.699401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.699401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.699401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.699401] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b692d00-090d-4fca-8b85-19b077d9435b is going to be created. [ 822.723356] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.725931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.725931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.725931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.725931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.734801] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b692d00-090d-4fca-8b85-19b077d9435b in Status: UNINITIALIZED for 2s [ 822.951981] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.083034] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.083230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.083304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.083528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.083974] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.084207] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.084305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.084374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.084544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.084622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.084710] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 is going to be updated. [ 823.113694] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.113847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.113898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.114125] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.114323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.123543] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 in Status: IN_PROGRESS for 2s [ 823.422437] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 823.422437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.454173] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.457275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.457275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.457275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.457275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.457275] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 823.495552] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.495552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.495552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.495552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.495552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.504957] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 824.418756] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b3af4b3c-4066-4366-9de2-a6a2ee5d2283 None None] Enqueued Resource ID: 344177fe-cd35-4cb8-a8c1-8543a1d7c151 with Priority: HIGHEST for action port [ 824.421122] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 344177fe-cd35-4cb8-a8c1-8543a1d7c151 with Priority: HIGHEST for action port [ 824.422560] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-344177fe-cd35-4cb8-a8c1-8543a1d7c151 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.425778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-344177fe-cd35-4cb8-a8c1-8543a1d7c151" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.425778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-344177fe-cd35-4cb8-a8c1-8543a1d7c151" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.425778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-344177fe-cd35-4cb8-a8c1-8543a1d7c151" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.425778] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('344177fe-cd35-4cb8-a8c1-8543a1d7c151',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.749157] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b692d00-090d-4fca-8b85-19b077d9435b in Status: SUCCESS [ 824.749157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.749157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.749157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.749157] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.749157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.749157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.749157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.749157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.749157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.749157] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b692d00-090d-4fca-8b85-19b077d9435b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.927167] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 344177fe-cd35-4cb8-a8c1-8543a1d7c151 [ 824.927167] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.927167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.927167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.927167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.927167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.927167] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:344177fe-cd35-4cb8-a8c1-8543a1d7c151 already deleted. [ 824.927167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-344177fe-cd35-4cb8-a8c1-8543a1d7c151" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.064751] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.065669] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.065669] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.065669] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.065972] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.066199] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.070129] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.070129] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.070129] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.070129] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.070129] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.070129] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.070129] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.070129] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.070129] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.070129] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.093741] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.093898] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.094050] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.094270] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.094635] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-0acbfa32-adde-4a6e-bfb6-c745a0b8524a taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.094833] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-0acbfa32-adde-4a6e-bfb6-c745a0b8524a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.094976] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-0acbfa32-adde-4a6e-bfb6-c745a0b8524a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.095312] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-0acbfa32-adde-4a6e-bfb6-c745a0b8524a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.095465] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0acbfa32-adde-4a6e-bfb6-c745a0b8524a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.135288] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 in Status: SUCCESS [ 825.135288] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 deletion is rescheduled due to dependency. [ 825.135446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.254213] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b692d00-090d-4fca-8b85-19b077d9435b taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.254213] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.254213] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b692d00-090d-4fca-8b85-19b077d9435b taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.254213] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.254213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.254693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.254693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.254693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.254693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.254693] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b692d00-090d-4fca-8b85-19b077d9435b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.516446] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 825.516614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.600238] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.600492] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.600617] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.600901] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.601054] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.601236] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 0acbfa32-adde-4a6e-bfb6-c745a0b8524a not found, creating... [ 825.601503] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.601657] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.601771] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.601989] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.602137] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.602452] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.606019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.606019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.606019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.606019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.606019] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 0acbfa32-adde-4a6e-bfb6-c745a0b8524a is going to be created. [ 825.638948] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.638948] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.638948] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.638948] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.638948] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.639204] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-0acbfa32-adde-4a6e-bfb6-c745a0b8524a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.757126] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b692d00-090d-4fca-8b85-19b077d9435b: rpc.has_security_group_logging(os_id): False [ 825.783058] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.783574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.783574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.783574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.783574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.783797] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.783895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.783956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.784119] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.784195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.784374] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.784480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.784544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.785308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.785308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.785308] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.785308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.785308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.785308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.785308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.785308] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b692d00-090d-4fca-8b85-19b077d9435b is going to be created. [ 825.858173] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.858314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.858528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.858592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.858761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.872440] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b692d00-090d-4fca-8b85-19b077d9435b in Status: IN_PROGRESS for 2s [ 826.596238] env[62909]: INFO networking_nsxv3.common.synchronization [req-c16e977e-d44f-4b5d-bcd9-10372fd93939 req-77c951d0-0bce-40aa-9f53-89a14bc4522c service nova] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_rules [ 826.596391] env[62909]: INFO networking_nsxv3.common.synchronization [req-c16e977e-d44f-4b5d-bcd9-10372fd93939 req-77c951d0-0bce-40aa-9f53-89a14bc4522c service nova] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 826.596486] env[62909]: INFO networking_nsxv3.common.synchronization [req-c16e977e-d44f-4b5d-bcd9-10372fd93939 req-77c951d0-0bce-40aa-9f53-89a14bc4522c service nova] Enqueued Resource ID: 0acbfa32-adde-4a6e-bfb6-c745a0b8524a with Priority: HIGHEST for action port [ 826.597611] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_rules [ 826.597828] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 826.597989] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0acbfa32-adde-4a6e-bfb6-c745a0b8524a with Priority: HIGHEST for action port [ 826.598418] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.598713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.598713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.598929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.599042] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.601438] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.601438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.601438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.601438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.601438] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.601438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.601438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.601438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.601438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.601438] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.602950] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-0acbfa32-adde-4a6e-bfb6-c745a0b8524a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.602950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0acbfa32-adde-4a6e-bfb6-c745a0b8524a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.602950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0acbfa32-adde-4a6e-bfb6-c745a0b8524a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.602950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0acbfa32-adde-4a6e-bfb6-c745a0b8524a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.602950] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0acbfa32-adde-4a6e-bfb6-c745a0b8524a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.641323] env[62909]: INFO networking_nsxv3.common.synchronization [req-3221c0d0-77b9-4fbe-845f-3fd145abc4e0 req-8bbb5bb9-e555-4328-a5bf-129c8bb250a8 tempest-ServersAdminTestJSON-1709758822 tempest-ServersAdminTestJSON-1709758822-project-member] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 826.644762] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 826.644762] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.644762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.644762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.644762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.644762] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.644762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.644762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.644762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.644762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.644762] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.007205] env[62909]: INFO networking_nsxv3.common.synchronization [None req-fb916713-3cf4-445e-bfde-12b318e2d046 tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_rules [ 827.007205] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_rules [ 827.008133] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.009903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.009903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.009903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.009903] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.105161] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.105449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.105493] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.106373] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0acbfa32-adde-4a6e-bfb6-c745a0b8524a with status ACTIVE [ 827.106570] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.106686] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.106755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.107096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.107096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.107272] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.107369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.107432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.107586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.107664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.107839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.107931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.107992] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.108528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.108669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.108753] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0acbfa32-adde-4a6e-bfb6-c745a0b8524a is going to be updated. [ 827.121066] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-13 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.121341] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.121471] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.121825] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.122360] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.122544] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.122666] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.122900] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.123077] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.123299] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.123414] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.123525] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.123640] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.123742] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.123849] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.123983] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.130745] env[62909]: INFO networking_nsxv3.common.synchronization [None req-23ac39cf-6c5d-40bf-8d3c-d2600c0cf21f None None] Enqueued Resource ID: 367b41e7-5859-4b0a-b043-8c14aeb10681 with Priority: HIGHEST for action port [ 827.133611] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367b41e7-5859-4b0a-b043-8c14aeb10681 with Priority: HIGHEST for action port [ 827.133611] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.134076] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.134171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.134385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.134526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.134693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0acbfa32-adde-4a6e-bfb6-c745a0b8524a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.135300] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-367b41e7-5859-4b0a-b043-8c14aeb10681 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.135438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-367b41e7-5859-4b0a-b043-8c14aeb10681" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.135515] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-367b41e7-5859-4b0a-b043-8c14aeb10681" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.135763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-367b41e7-5859-4b0a-b043-8c14aeb10681" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.135859] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('367b41e7-5859-4b0a-b043-8c14aeb10681',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.146658] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.146808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.146878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.147106] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.147190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.147376] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.147465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.147523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.147666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.147735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.147821] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 already deleted. [ 827.147895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.155442] env[62909]: INFO networking_nsxv3.common.synchronization [None req-5ca9911c-b646-490f-a8c2-f87baef09403 tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_rules [ 827.156175] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_rules [ 827.156483] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.156579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.160521] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.160683] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 827.160823] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.161018] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.161360] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.161533] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.161651] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.161984] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.162134] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.531884] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.531884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.531884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.531884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.531884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.531884] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 already deleted. [ 827.531884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.531884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.531884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.531884] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.612456] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.641187] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 367b41e7-5859-4b0a-b043-8c14aeb10681 [ 827.641527] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.641666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.641727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.641942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.642041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.642141] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:367b41e7-5859-4b0a-b043-8c14aeb10681 already deleted. [ 827.642234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-367b41e7-5859-4b0a-b043-8c14aeb10681" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.664401] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.664401] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.664669] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.664845] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.665017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.665188] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2 not found, creating... [ 827.665481] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.665646] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.665782] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.666044] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.666197] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.666886] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.666886] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.666886] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.667144] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.671137] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.674586] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2 is going to be created. [ 827.699166] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.699417] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.699561] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.699881] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.700197] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.700668] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.886055] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b692d00-090d-4fca-8b85-19b077d9435b in Status: SUCCESS [ 827.886055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.054676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.055126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.055126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.055126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.055224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.055284] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 already deleted. [ 828.055366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.114688] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.114883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.114929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.115156] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.115254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.115508] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 828.146910] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.147079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.147079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.147336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.147478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.158739] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 828.727859] env[62909]: INFO networking_nsxv3.common.synchronization [req-3221c0d0-77b9-4fbe-845f-3fd145abc4e0 req-f288f0ba-063a-478d-96bd-3ef739ae65dd service nova] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_rules [ 828.728023] env[62909]: INFO networking_nsxv3.common.synchronization [req-3221c0d0-77b9-4fbe-845f-3fd145abc4e0 req-f288f0ba-063a-478d-96bd-3ef739ae65dd service nova] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 828.728237] env[62909]: INFO networking_nsxv3.common.synchronization [req-3221c0d0-77b9-4fbe-845f-3fd145abc4e0 req-f288f0ba-063a-478d-96bd-3ef739ae65dd service nova] Enqueued Resource ID: 4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2 with Priority: HIGHEST for action port [ 828.728451] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_rules [ 828.728708] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 828.728708] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2 with Priority: HIGHEST for action port [ 828.729504] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.729642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.729706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.730530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.730530] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.731958] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.732120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.732196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.732394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.732560] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.732654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.732712] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.732850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.732994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.733114] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.734518] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.734661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.735217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.735217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.735217] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.145012] env[62909]: INFO networking_nsxv3.common.synchronization [req-75c72e08-4241-49b2-a878-b89e661cf35c req-8215c413-32eb-466a-91a2-c3b7a2665d5e tempest-ServersAdminTestJSON-1709758822 tempest-ServersAdminTestJSON-1709758822-project-member] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 829.145303] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 829.145513] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.149017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.236767] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.238945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.238945] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.239871] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2 with status ACTIVE [ 829.240645] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.240781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.240851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.241081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.244373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.244663] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.244785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.244855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.245075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.245181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.245386] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.245489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.245550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.245709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.245783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.245887] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2 is going to be updated. [ 829.269596] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.269752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.269846] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.270090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.270338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.270519] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a22be80-3c2e-4a9d-a348-f64b8b0e0ee2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.493351] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-13 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.493504] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.493634] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.493917] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.494187] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.494500] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.494500] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.494676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.494822] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.495292] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.495547] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.495645] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.495695] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.495811] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.495924] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.496085] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.518032] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.518032] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.518032] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.518298] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.518442] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-b8eb6717-ecdc-4bbe-ad47-b975cf486bfa taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.518624] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-b8eb6717-ecdc-4bbe-ad47-b975cf486bfa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.518773] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-b8eb6717-ecdc-4bbe-ad47-b975cf486bfa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.519106] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-b8eb6717-ecdc-4bbe-ad47-b975cf486bfa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.519257] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8eb6717-ecdc-4bbe-ad47-b975cf486bfa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.748768] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.022055] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.022298] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.022430] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.022887] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.022982] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.023164] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port b8eb6717-ecdc-4bbe-ad47-b975cf486bfa not found, creating... [ 830.023444] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.023618] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.023748] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.023982] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.024137] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.024437] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.024596] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.024715] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.024933] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.025189] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.025334] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: b8eb6717-ecdc-4bbe-ad47-b975cf486bfa is going to be created. [ 830.085230] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.085462] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.085593] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.085878] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.086130] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.086367] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-b8eb6717-ecdc-4bbe-ad47-b975cf486bfa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.177107] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 830.177454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.177563] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.177813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.178071] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.178313] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.178383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.178547] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.178627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.178713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.178803] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.253123] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.253451] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.253550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.253771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.253863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.253966] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be created. [ 830.296194] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.296330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.296397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.296607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.296767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.307413] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: UNINITIALIZED for 2s [ 830.682994] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.682994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.682994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.682994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.682994] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.682994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.682994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.682994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.682994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.682994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.682994] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.682994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.683523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.683523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.683523] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.683523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.683523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.683650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.683677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.683751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.683842] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.186594] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e66bfb9-974f-43a6-93f8-54f17b7d81b3: rpc.has_security_group_logging(os_id): False [ 831.210099] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.210369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.210442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.210669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.210810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.210949] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.211085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.211182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.211377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.211503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.211735] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.211855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.211899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.212076] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.212180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.212414] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.212691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.212816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.212998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.213104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.213240] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 831.257319] env[62909]: INFO networking_nsxv3.common.synchronization [req-75c72e08-4241-49b2-a878-b89e661cf35c req-786fa5e1-0ace-411e-b667-8fd805b7a851 service nova] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_rules [ 831.257522] env[62909]: INFO networking_nsxv3.common.synchronization [req-75c72e08-4241-49b2-a878-b89e661cf35c req-786fa5e1-0ace-411e-b667-8fd805b7a851 service nova] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 831.257720] env[62909]: INFO networking_nsxv3.common.synchronization [req-75c72e08-4241-49b2-a878-b89e661cf35c req-786fa5e1-0ace-411e-b667-8fd805b7a851 service nova] Enqueued Resource ID: b8eb6717-ecdc-4bbe-ad47-b975cf486bfa with Priority: HIGHEST for action port [ 831.258553] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_rules [ 831.258729] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 831.258848] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8eb6717-ecdc-4bbe-ad47-b975cf486bfa with Priority: HIGHEST for action port [ 831.259430] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.259430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.259644] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.259644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.260856] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8eb6717-ecdc-4bbe-ad47-b975cf486bfa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.260986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8eb6717-ecdc-4bbe-ad47-b975cf486bfa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.261081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8eb6717-ecdc-4bbe-ad47-b975cf486bfa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.261438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8eb6717-ecdc-4bbe-ad47-b975cf486bfa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.261581] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8eb6717-ecdc-4bbe-ad47-b975cf486bfa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.304084] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.304350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.304441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.304665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.304820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.331210] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 831.763576] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8eb6717-ecdc-4bbe-ad47-b975cf486bfa with status ACTIVE [ 831.764499] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.764499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.764499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.764499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.764499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.764499] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.764952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.764952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.764952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.764952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.765161] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.765321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.765321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.765441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.765516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.765598] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8eb6717-ecdc-4bbe-ad47-b975cf486bfa is going to be updated. [ 831.793539] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.793814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.793814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.793947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.794088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.794222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8eb6717-ecdc-4bbe-ad47-b975cf486bfa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.315774] env[62909]: INFO networking_nsxv3.common.synchronization [req-b51aae01-f294-48ac-b01c-7e03cdf44b3a req-fcfb8bbe-abde-46f2-a2d5-bc394cf3668f tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 832.316900] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 832.318867] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 832.318867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.318867] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.319113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.319113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.319293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.319293] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.319459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.319459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.319581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.319661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.319754] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.324414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.324414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.324414] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.324414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.324414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.324732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.328489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.328489] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.830268] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.830439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.831355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.831620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.831720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.831931] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.832049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.832109] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.832262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.832332] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.832528] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be deleted. [ 832.833490] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.866543] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.866739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.866739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.866957] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.867069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.867172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.948759] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.948958] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.949098] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.949422] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.949840] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.949840] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.949997] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.950260] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.950416] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.950629] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.950742] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.950851] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.950966] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.951089] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.951214] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.953223] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.973036] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.973036] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.973036] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.973241] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.973784] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-e7fd222f-0127-4616-8d16-801a8c35a0d1 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.974190] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-e7fd222f-0127-4616-8d16-801a8c35a0d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.974469] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-e7fd222f-0127-4616-8d16-801a8c35a0d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.976261] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-e7fd222f-0127-4616-8d16-801a8c35a0d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.976261] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7fd222f-0127-4616-8d16-801a8c35a0d1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.338500] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.346511] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 833.346832] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.477855] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.478194] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.478374] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.478746] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.478920] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.479169] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port e7fd222f-0127-4616-8d16-801a8c35a0d1 not found, creating... [ 833.479502] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.479709] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.479870] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.480160] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.480390] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.480756] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.480960] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.481161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.481513] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.481698] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.481891] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: e7fd222f-0127-4616-8d16-801a8c35a0d1 is going to be created. [ 833.504106] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.504350] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.504484] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.504772] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.505017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.505262] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-e7fd222f-0127-4616-8d16-801a8c35a0d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.841171] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.841171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.841383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.841534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.841636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.841755] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 833.886028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.886028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.886028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.886028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.886028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.897175] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 834.729365] env[62909]: INFO networking_nsxv3.common.synchronization [req-44fd8089-175b-4929-b3bf-9f79f91ddc38 req-8a6601c3-4411-46f4-9134-9bae5b74831a tempest-FloatingIPsAssociationTestJSON-150665211 tempest-FloatingIPsAssociationTestJSON-150665211-project-member] Enqueued Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 834.730118] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 834.730629] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.731236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.731236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.731236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.731708] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.731708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.732180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.732180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.732180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.732530] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.856647] env[62909]: INFO networking_nsxv3.common.synchronization [req-b51aae01-f294-48ac-b01c-7e03cdf44b3a req-16df27aa-43e6-4aff-a925-8aad87df4419 service nova] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_rules [ 834.862579] env[62909]: INFO networking_nsxv3.common.synchronization [req-b51aae01-f294-48ac-b01c-7e03cdf44b3a req-16df27aa-43e6-4aff-a925-8aad87df4419 service nova] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 834.862579] env[62909]: INFO networking_nsxv3.common.synchronization [req-b51aae01-f294-48ac-b01c-7e03cdf44b3a req-16df27aa-43e6-4aff-a925-8aad87df4419 service nova] Enqueued Resource ID: e7fd222f-0127-4616-8d16-801a8c35a0d1 with Priority: HIGHEST for action port [ 834.862579] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_rules [ 834.862579] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 834.862579] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7fd222f-0127-4616-8d16-801a8c35a0d1 with Priority: HIGHEST for action port [ 834.862579] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.862579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.862579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.862579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.862579] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.864029] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.864182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.864258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.866454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.866454] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.866454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.866454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.866454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.866454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.866454] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.866454] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7fd222f-0127-4616-8d16-801a8c35a0d1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.866454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7fd222f-0127-4616-8d16-801a8c35a0d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.866454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7fd222f-0127-4616-8d16-801a8c35a0d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.867058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7fd222f-0127-4616-8d16-801a8c35a0d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.867058] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7fd222f-0127-4616-8d16-801a8c35a0d1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.166343] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-614 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.166774] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-614" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.167056] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-614" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.167485] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-614" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.167939] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.168264] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.168535] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.169498] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.169778] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.170202] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.170385] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.170589] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.170875] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.171131] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.171342] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.171589] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.208046] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.208232] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.208383] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.208565] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-614" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.208907] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-705a7360-47b1-4951-92f7-277ca049efa1 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.209101] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-705a7360-47b1-4951-92f7-277ca049efa1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.209227] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-705a7360-47b1-4951-92f7-277ca049efa1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.209578] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-705a7360-47b1-4951-92f7-277ca049efa1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.210443] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('705a7360-47b1-4951-92f7-277ca049efa1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.238395] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.369146] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.369704] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.369822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.369961] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7fd222f-0127-4616-8d16-801a8c35a0d1 with status ACTIVE [ 835.370123] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.370292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.370357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.370574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.370720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.370903] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.371014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.371097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.371345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.371431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.371616] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.371756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.371858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.372862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.372981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.373124] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7fd222f-0127-4616-8d16-801a8c35a0d1 is going to be updated. [ 835.398260] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.398494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.398684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.401850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.401850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.401850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7fd222f-0127-4616-8d16-801a8c35a0d1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.714752] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.714752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.714752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.714752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.714752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.714752] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 705a7360-47b1-4951-92f7-277ca049efa1 not found, creating... [ 835.714752] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.714752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.714752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.714752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.714752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.715356] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.715356] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.715798] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.716181] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.716467] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.716757] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 705a7360-47b1-4951-92f7-277ca049efa1 is going to be created. [ 835.740971] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.740971] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.740971] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.740971] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.740971] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.740971] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-705a7360-47b1-4951-92f7-277ca049efa1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.740971] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.876792] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.913277] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 835.913516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.913699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.914488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.914488] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.914488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.914716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.914716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.914805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.914935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.915165] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.917069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.917069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.917069] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.917310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.917310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.917404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.917491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.917593] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.245553] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.245831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.245993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.246331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.246502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.246681] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e is going to be updated. [ 836.281613] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.281769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.281833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.282090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.282271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.295874] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: IN_PROGRESS for 2s [ 836.343268] env[62909]: INFO networking_nsxv3.common.synchronization [req-e15ce992-ade1-4939-abed-24cf54142093 req-bf4ef099-24a0-48c0-985f-a47ff7087cfb tempest-ServerPasswordTestJSON-2059654700 tempest-ServerPasswordTestJSON-2059654700-project-member] Enqueued Resource ID: 6b692d00-090d-4fca-8b85-19b077d9435b with Priority: HIGHEST for action security_group_members [ 836.343882] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b692d00-090d-4fca-8b85-19b077d9435b with Priority: HIGHEST for action security_group_members [ 836.344295] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b692d00-090d-4fca-8b85-19b077d9435b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.345098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.345207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.345448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.345651] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.345790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.345876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.346140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.346262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.346386] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b692d00-090d-4fca-8b85-19b077d9435b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.379189] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.379328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.379386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.379618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.379719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.379815] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be created. [ 836.404221] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.404512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.406262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.406262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.406262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.416369] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: UNINITIALIZED for 2s [ 836.419946] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.420088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.421442] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.468738] env[62909]: INFO networking_nsxv3.common.synchronization [req-44fd8089-175b-4929-b3bf-9f79f91ddc38 req-c12ac37f-f15a-48ce-b81e-738f1924ff2e service nova] Enqueued Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_rules [ 836.468964] env[62909]: INFO networking_nsxv3.common.synchronization [req-44fd8089-175b-4929-b3bf-9f79f91ddc38 req-c12ac37f-f15a-48ce-b81e-738f1924ff2e service nova] Enqueued Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 836.469205] env[62909]: INFO networking_nsxv3.common.synchronization [req-44fd8089-175b-4929-b3bf-9f79f91ddc38 req-c12ac37f-f15a-48ce-b81e-738f1924ff2e service nova] Enqueued Resource ID: 705a7360-47b1-4951-92f7-277ca049efa1 with Priority: HIGHEST for action port [ 836.469741] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_rules [ 836.469912] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 836.470283] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705a7360-47b1-4951-92f7-277ca049efa1 with Priority: HIGHEST for action port [ 836.470626] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.470759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.470822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.471073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.471157] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.472950] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.473090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.473296] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-705a7360-47b1-4951-92f7-277ca049efa1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.474039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-705a7360-47b1-4951-92f7-277ca049efa1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.474039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-705a7360-47b1-4951-92f7-277ca049efa1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.474039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-705a7360-47b1-4951-92f7-277ca049efa1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.474039] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('705a7360-47b1-4951-92f7-277ca049efa1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.848688] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.849081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.849081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.849233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.849233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.849492] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.849631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.849716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.849889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.849988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.850111] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b692d00-090d-4fca-8b85-19b077d9435b is going to be updated. [ 836.880266] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.880463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.880529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.880784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.881014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.891626] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b692d00-090d-4fca-8b85-19b077d9435b in Status: IN_PROGRESS for 2s [ 836.927466] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.976452] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.976595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.976787] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 705a7360-47b1-4951-92f7-277ca049efa1 with status ACTIVE [ 836.976972] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.977094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.977161] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.977361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.977449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.977620] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.977714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.977777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.977919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.977994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.978197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.978303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.978365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.978507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.978579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.978664] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 705a7360-47b1-4951-92f7-277ca049efa1 is going to be updated. [ 837.005368] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.005510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.005578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.005791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.005924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.006094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-705a7360-47b1-4951-92f7-277ca049efa1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.396538] env[62909]: INFO networking_nsxv3.common.synchronization [req-43494bd3-f31a-4477-9e1c-2f54fac48903 req-9d40a5ae-8139-4473-80cf-d4bb21198eff tempest-MultipleCreateTestJSON-1768884473 tempest-MultipleCreateTestJSON-1768884473-project-member] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 837.396809] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 837.397125] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.397248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.397314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.397577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.400759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.400759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.400759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.400759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.400759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.400759] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.429681] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.429845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.429902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.430149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.430268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.430625] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 837.462875] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.462875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.464299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.464299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.464299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.474832] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 837.763138] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-218 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.763378] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.763541] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.763918] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.764455] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.764678] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.764849] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.765141] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.765326] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.765552] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.765723] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.765778] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.765892] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.766015] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.766133] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.766273] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.785994] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.787108] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 837.787108] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.787108] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.787108] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-5318eee4-4de3-4b6a-acef-6991fa42dabc taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.787108] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-5318eee4-4de3-4b6a-acef-6991fa42dabc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.787108] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-5318eee4-4de3-4b6a-acef-6991fa42dabc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.787456] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-5318eee4-4de3-4b6a-acef-6991fa42dabc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.787594] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5318eee4-4de3-4b6a-acef-6991fa42dabc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.903176] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.903515] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.903515] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.903680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.903760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.904155] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.904155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.904383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.904383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.904535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.904535] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 already deleted. [ 837.904634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.290039] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.290335] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.290606] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.294022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.294022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.294022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 5318eee4-4de3-4b6a-acef-6991fa42dabc not found, creating... [ 838.294022] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.294022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.294022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.294022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.294022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.294022] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.294022] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.294471] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.294471] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.294471] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.294471] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 5318eee4-4de3-4b6a-acef-6991fa42dabc is going to be created. [ 838.310281] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: SUCCESS [ 838.310523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.310724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.310960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.311237] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.311380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.311450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.311647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.311750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.311859] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.320124] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.320315] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.320439] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.320692] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.320945] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.321150] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-5318eee4-4de3-4b6a-acef-6991fa42dabc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.431383] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 838.432187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.432362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.432510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.433641] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.433807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.433880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.434103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.434168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.434932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.434932] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.765874] env[62909]: INFO networking_nsxv3.common.synchronization [req-74936c65-bc88-4b1c-8287-5527153ac62c req-84fb5517-e1cc-4164-bc29-9a0c1528c64c tempest-ListServerFiltersTestJSON-403224292 tempest-ListServerFiltersTestJSON-403224292-project-member] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 838.766884] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 838.767442] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.767628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.767719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.768480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.768480] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.768646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.768768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.769305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.769305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.769430] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.815064] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.903607] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b692d00-090d-4fca-8b85-19b077d9435b in Status: SUCCESS [ 838.903920] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b692d00-090d-4fca-8b85-19b077d9435b deletion is rescheduled due to dependency. [ 838.903920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.937127] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.937341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.937415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.938241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.938241] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.938241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.938241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.938241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.938576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.938576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.938576] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.938669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.938669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.938787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.938921] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.939143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.939143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.939247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.939291] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.939373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.939417] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.273679] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.317690] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.442095] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f6e0db7-41ba-43f5-b841-2551ea96a39f: rpc.has_security_group_logging(os_id): False [ 839.460682] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.460862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.460936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.461212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.461266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.461469] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.461632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.461692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.461853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.461940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.462129] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.462237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.462289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.462415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.462488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.462731] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.462785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.462835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.463038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.463090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.463149] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be created. [ 839.486081] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 839.486081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.486081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.486404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.486461] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.486558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.486620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.486784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.486913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.487041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.487225] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.487319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.487408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.487628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.487795] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.487903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.487980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.488116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.488195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.488332] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.488409] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.507681] env[62909]: INFO networking_nsxv3.common.synchronization [req-43494bd3-f31a-4477-9e1c-2f54fac48903 req-b9366b93-ab8c-4902-a4dd-5393b6834a59 service nova] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_rules [ 839.508240] env[62909]: INFO networking_nsxv3.common.synchronization [req-43494bd3-f31a-4477-9e1c-2f54fac48903 req-b9366b93-ab8c-4902-a4dd-5393b6834a59 service nova] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 839.508528] env[62909]: INFO networking_nsxv3.common.synchronization [req-43494bd3-f31a-4477-9e1c-2f54fac48903 req-b9366b93-ab8c-4902-a4dd-5393b6834a59 service nova] Enqueued Resource ID: 5318eee4-4de3-4b6a-acef-6991fa42dabc with Priority: HIGHEST for action port [ 839.509220] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_rules [ 839.509435] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 839.509615] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5318eee4-4de3-4b6a-acef-6991fa42dabc with Priority: HIGHEST for action port [ 839.510042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.510273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.510531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.510904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.511055] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.512861] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.512995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.513095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.513277] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.513447] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.513545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.513607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.513754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.513837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.513930] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.515234] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5318eee4-4de3-4b6a-acef-6991fa42dabc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.515351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5318eee4-4de3-4b6a-acef-6991fa42dabc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.515421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5318eee4-4de3-4b6a-acef-6991fa42dabc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.515601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5318eee4-4de3-4b6a-acef-6991fa42dabc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.515686] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5318eee4-4de3-4b6a-acef-6991fa42dabc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.531039] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.531252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.531252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.531458] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.531644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.548735] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 839.775895] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.820389] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.820568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.820624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.820833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.820903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.820995] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e is going to be updated. [ 839.855175] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.855376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.855376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.855597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.855790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.866022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: IN_PROGRESS for 2s [ 839.990863] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5: rpc.has_security_group_logging(os_id): False [ 840.016371] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.016371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.016371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.016371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.016371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.016650] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.016650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.016743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.016973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.017103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.017382] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.017552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.017648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.017842] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.017950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.022057] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.022190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.022261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.022454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.022549] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.022638] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be created. [ 840.024302] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.024302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.024486] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.025426] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5318eee4-4de3-4b6a-acef-6991fa42dabc with status ACTIVE [ 840.025605] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.025724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.025826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.025980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.026081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.026310] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.026450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.026450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.026705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.026867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.027019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.027124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.027186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.027626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.027626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.027626] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5318eee4-4de3-4b6a-acef-6991fa42dabc is going to be updated. [ 840.115295] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.115665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.115665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.115765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.115914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.116099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5318eee4-4de3-4b6a-acef-6991fa42dabc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.229540] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.229702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.229739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.229955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.230151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.248578] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 840.278411] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.278621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.278698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.278924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.279028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.279154] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be updated. [ 840.346037] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.346037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.346037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.346037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.346037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.357646] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 840.531299] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.033975] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.034406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.034406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.034669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.034821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.034989] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be created. [ 841.061494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.061716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.061762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.061956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.062135] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.076487] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: UNINITIALIZED for 2s [ 841.289525] env[62909]: INFO networking_nsxv3.common.synchronization [req-4356f038-efc5-41c9-b3ea-b4f887c88cf0 req-3c902a4c-fa81-4869-ae71-9a462dba768e tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 841.289525] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 841.297401] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.297401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.297401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.297401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.297401] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.297401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.297401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.297401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.297401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.297401] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.564832] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 841.565162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.739110] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e10acf2d-7b1a-4da5-87b6-c18ac6ec079c tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 841.739991] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 841.740155] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.740155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.798832] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.877312] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: SUCCESS [ 841.877531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.878917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.878917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.878917] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.878917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.878917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.878917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.878917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.878917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.878917] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.261383] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 842.261691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.261800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.262025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.262123] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.301809] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.368553] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 842.368787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.381454] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.381617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.381659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.382749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.382749] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.382749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.382749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.382749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.382749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.382749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.383142] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.383277] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.383314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.383459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.383633] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.383726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.383786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.384488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.384617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.384760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.385147] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.765133] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.765343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.765425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.765940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.765940] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.765940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.765940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.766246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.766246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.766246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.766344] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.804664] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.804664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.804664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.804664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.804664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.804664] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 842.837431] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.837578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.837645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.837855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.837998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.848987] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 842.888657] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 009d27ce-c5b1-4df0-81b4-05b91e8ed19e: rpc.has_security_group_logging(os_id): False [ 842.908356] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.908516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.908592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.908804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.929632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.930015] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.930186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.930408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.930554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.930785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.930924] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.931069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.931146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.931343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.931448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.931683] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.931804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.931886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.933359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.933524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.933651] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e is going to be updated. [ 843.009508] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.009647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.009703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.009921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.010086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.026859] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: IN_PROGRESS for 2s [ 843.093852] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 843.094096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.094269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.094494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.094683] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.094800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.094866] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.095030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.095112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.095198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.095290] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.268509] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.268817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.268817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.268970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.269665] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.269782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.269863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.270047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.270140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.270303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.270413] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.270538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.270583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.270720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.270888] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.270965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.271079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.271166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.271292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.271292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.271424] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.600428] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.600643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.600643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.600863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.601050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.601165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.601234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.601402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.601494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.601582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.601757] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.601862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.601924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.602121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.602224] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.602316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.602374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.602508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.602664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.602783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.602880] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.774646] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5: rpc.has_security_group_logging(os_id): False [ 843.795127] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.795473] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.795473] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.795568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.795626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.795819] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.795933] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.795972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.799211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.799211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.799211] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.799211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.799211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.799211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.799211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.799211] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.799211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.799211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.799211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.799211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.799211] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 843.861839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.862712] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.862712] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.862712] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.862865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.878443] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 843.957335] env[62909]: INFO networking_nsxv3.common.synchronization [req-f245d120-664c-4e0b-b6ca-3727911a4b13 req-ea02c913-1b7b-49de-baa1-2dc217128b7c tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_members [ 843.957632] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGHEST for action security_group_members [ 843.958022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-70dd2e08-5d3c-47df-8c82-524cc320dde0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.958239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.958368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.958534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.958862] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.958862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.958862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.959050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.959093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.959167] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.104906] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3c6858c-f90d-4b04-bbda-341ff7525e29: rpc.has_security_group_logging(os_id): False [ 844.128044] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.128156] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.128221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.128513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.128612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.128812] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.128915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.128978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.130538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.130538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.130538] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.130538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.130538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.130538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.130538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.130538] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.130538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.130538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.130538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.130538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.130538] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be created. [ 844.202598] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.202770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.202871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.203092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.203317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.216286] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 844.461544] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.461900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.461900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.462206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.490555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.490749] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.490871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.490937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.491167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.491249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.491358] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 is going to be updated. [ 844.523559] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.523748] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.523834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.524083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.524221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.534016] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 in Status: IN_PROGRESS for 2s [ 844.862028] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 844.863021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.863021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.863021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.863021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.863021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.863021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.863289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.863464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.863630] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.044016] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: SUCCESS [ 845.044267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.371055] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.371055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.371055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.371055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.371055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.371055] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.371055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.371055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.371055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.371055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.371055] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 845.396966] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.397134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.397182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.397400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.397538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.407437] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 845.900301] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 845.900673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.230696] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 846.230942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.543469] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 in Status: SUCCESS [ 846.543655] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 deletion is rescheduled due to dependency. [ 846.543762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.419190] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 847.419466] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 deletion is rescheduled due to dependency. [ 847.419466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.958256] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 848.958537] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 853.960074] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 853.960422] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 855.125955] env[62909]: INFO networking_nsxv3.common.synchronization [req-43494bd3-f31a-4477-9e1c-2f54fac48903 req-092be688-1a4b-4ac4-845e-934d73170961 tempest-MultipleCreateTestJSON-1768884473 tempest-MultipleCreateTestJSON-1768884473-project-member] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 855.126398] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 855.126685] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.126812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.126874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.127853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.128042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.128165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.128256] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.129476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.129476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.129476] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.509090] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-218 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.509309] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.509441] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.509712] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.509975] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.510377] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.510514] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.510742] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.510907] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.511157] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 855.511274] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.511429] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.511563] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.511689] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 855.511800] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.511941] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.536084] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.536310] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 855.536459] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.536636] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.536963] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-a0474c06-0c2f-4fe9-8636-c16aa5b3bca8 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.537178] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-a0474c06-0c2f-4fe9-8636-c16aa5b3bca8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.537327] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-a0474c06-0c2f-4fe9-8636-c16aa5b3bca8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.537708] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-a0474c06-0c2f-4fe9-8636-c16aa5b3bca8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.537847] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0474c06-0c2f-4fe9-8636-c16aa5b3bca8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.631285] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.040809] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.041148] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.041350] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.041764] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.041992] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.042241] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port a0474c06-0c2f-4fe9-8636-c16aa5b3bca8 not found, creating... [ 856.042644] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.042889] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.043094] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.043430] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.043648] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.044098] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.044342] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.044539] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.044868] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.045336] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.045336] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: a0474c06-0c2f-4fe9-8636-c16aa5b3bca8 is going to be created. [ 856.067019] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.067322] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.067693] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.067894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.068246] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.068577] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-a0474c06-0c2f-4fe9-8636-c16aa5b3bca8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.133581] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.636094] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.636262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.636437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.636544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.636702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.636793] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 856.668155] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.668155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.668155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.669851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.669851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.681048] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 856.690250] env[62909]: INFO networking_nsxv3.common.synchronization [req-13372324-46de-4d5d-b101-cb5e50647efb req-991f98de-b831-4496-9b52-2f4185997bdf tempest-FloatingIPsAssociationTestJSON-150665211 tempest-FloatingIPsAssociationTestJSON-150665211-project-member] Enqueued Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 856.690844] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 856.691158] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.691270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.691333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.691528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.691672] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.691763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.691823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.691962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.692219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.692320] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.888700] env[62909]: INFO networking_nsxv3.common.synchronization [req-43494bd3-f31a-4477-9e1c-2f54fac48903 req-1f7343b8-db3a-4870-90d2-7fe8c707ed0f service nova] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_rules [ 856.888960] env[62909]: INFO networking_nsxv3.common.synchronization [req-43494bd3-f31a-4477-9e1c-2f54fac48903 req-1f7343b8-db3a-4870-90d2-7fe8c707ed0f service nova] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 856.889826] env[62909]: INFO networking_nsxv3.common.synchronization [req-43494bd3-f31a-4477-9e1c-2f54fac48903 req-1f7343b8-db3a-4870-90d2-7fe8c707ed0f service nova] Enqueued Resource ID: a0474c06-0c2f-4fe9-8636-c16aa5b3bca8 with Priority: HIGHEST for action port [ 856.890727] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_rules [ 856.890966] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 856.891183] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0474c06-0c2f-4fe9-8636-c16aa5b3bca8 with Priority: HIGHEST for action port [ 856.891667] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.891880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.892023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.893613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.893771] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.896075] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.896279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.896639] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0474c06-0c2f-4fe9-8636-c16aa5b3bca8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.896855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0474c06-0c2f-4fe9-8636-c16aa5b3bca8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.896988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0474c06-0c2f-4fe9-8636-c16aa5b3bca8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.898241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0474c06-0c2f-4fe9-8636-c16aa5b3bca8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.898241] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0474c06-0c2f-4fe9-8636-c16aa5b3bca8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.194622] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.397158] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.397277] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.401070] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0474c06-0c2f-4fe9-8636-c16aa5b3bca8 with status ACTIVE [ 857.401070] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.401070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.401277] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.401417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.401516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.401750] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.401883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.401883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.402025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.402119] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.402277] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.402365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.402416] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.402824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.402824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.402824] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0474c06-0c2f-4fe9-8636-c16aa5b3bca8 is going to be updated. [ 857.430352] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.430352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.430707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.430707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.430813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.430977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0474c06-0c2f-4fe9-8636-c16aa5b3bca8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.698050] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.176884] env[62909]: INFO networking_nsxv3.common.synchronization [req-95ed1a6f-5ea9-45df-91c9-5ce43238be56 req-eacbb529-2dc2-4044-a77e-76f819f4482e tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 858.177505] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 858.177846] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.177895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.177962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.178456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.178660] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.178802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.178911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.179121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.179232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.182319] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.202466] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.202849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.202849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.205041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.205041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.205041] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e is going to be updated. [ 858.236258] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.236405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.236499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.236845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.236933] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.245533] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: IN_PROGRESS for 2s [ 858.681717] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.693381] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 858.693671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.695312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.695411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.695575] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.695738] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.695787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.695953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.696074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.696149] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.171978] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.172386] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.172624] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.173050] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.173467] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.173883] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.174118] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.174455] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.176271] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.176505] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.176628] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.176745] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.176857] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.176969] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.177090] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.177242] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.184764] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.203907] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.203907] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 859.203907] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.203907] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.203907] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-a6bab462-94fa-4095-9dbf-83474e5057dd taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.203907] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-a6bab462-94fa-4095-9dbf-83474e5057dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.203907] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-a6bab462-94fa-4095-9dbf-83474e5057dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.203907] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-a6bab462-94fa-4095-9dbf-83474e5057dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.203907] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6bab462-94fa-4095-9dbf-83474e5057dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.205894] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.687341] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.687543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.687543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.687758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.687855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.687964] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 859.709466] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.709968] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.710219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.710702] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.710997] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.711278] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port a6bab462-94fa-4095-9dbf-83474e5057dd not found, creating... [ 859.711774] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.712681] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.713041] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.713491] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.713804] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.714347] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.714730] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.715027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.715545] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.716473] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.716760] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: a6bab462-94fa-4095-9dbf-83474e5057dd is going to be created. [ 859.718737] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.720625] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.721076] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.721076] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.721443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.722122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.733802] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 859.744799] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.745143] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.745417] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.745588] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.746115] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.747437] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-a6bab462-94fa-4095-9dbf-83474e5057dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.220291] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.220811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.220811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.220811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.220938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.221060] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 860.256411] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: SUCCESS [ 860.256626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.288824] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.288824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.288824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.288824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.288824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.304025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 860.637286] env[62909]: INFO networking_nsxv3.common.synchronization [req-714a02d9-838d-459a-9840-be961404f249 req-a08c287a-7a3e-47ed-8ab7-6b6ebd43e9c0 tempest-MigrationsAdminTest-16747298 tempest-MigrationsAdminTest-16747298-project-member] Enqueued Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 860.637830] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 860.640928] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.641116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.641160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.641432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.641619] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.641762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.641794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.641951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.642210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.642210] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.739525] env[62909]: INFO networking_nsxv3.common.synchronization [req-95ed1a6f-5ea9-45df-91c9-5ce43238be56 req-3a13d5a1-8dfd-473a-ba3f-6ffc487a655e service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 860.739866] env[62909]: INFO networking_nsxv3.common.synchronization [req-95ed1a6f-5ea9-45df-91c9-5ce43238be56 req-3a13d5a1-8dfd-473a-ba3f-6ffc487a655e service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 860.740131] env[62909]: INFO networking_nsxv3.common.synchronization [req-95ed1a6f-5ea9-45df-91c9-5ce43238be56 req-3a13d5a1-8dfd-473a-ba3f-6ffc487a655e service nova] Enqueued Resource ID: a6bab462-94fa-4095-9dbf-83474e5057dd with Priority: HIGHEST for action port [ 860.740498] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 860.740653] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 860.740775] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6bab462-94fa-4095-9dbf-83474e5057dd with Priority: HIGHEST for action port [ 860.741231] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.741379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.741485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.741669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.741766] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.742913] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.742913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.743107] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6bab462-94fa-4095-9dbf-83474e5057dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.743107] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6bab462-94fa-4095-9dbf-83474e5057dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.743219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6bab462-94fa-4095-9dbf-83474e5057dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.743379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6bab462-94fa-4095-9dbf-83474e5057dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.743488] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6bab462-94fa-4095-9dbf-83474e5057dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.942875] env[62909]: INFO networking_nsxv3.common.synchronization [req-b3276513-5278-45fe-94a4-88d9db8b717c req-d1e812e4-b29a-49ab-8530-3e0fbdbef740 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 860.942875] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 860.943583] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.943583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.943583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.943583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.943784] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.943784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.943784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.943922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.945411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.945411] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.151066] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.246206] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.246206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.246206] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6bab462-94fa-4095-9dbf-83474e5057dd with status ACTIVE [ 861.246206] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.246206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.247047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.247047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.247047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.247047] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.247047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.247047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.247047] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.247298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.247298] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.247361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.247388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.247527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.247592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.247676] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6bab462-94fa-4095-9dbf-83474e5057dd is going to be updated. [ 861.269133] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.269696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.269769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.269983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.270140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.270612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6bab462-94fa-4095-9dbf-83474e5057dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.450885] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.578315] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.578315] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-557" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.578315] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-557" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.578315] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-557" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.578315] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.578315] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.578315] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.578315] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.578315] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.578315] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.578315] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.578315] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.578315] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.578989] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.578989] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.578989] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.604244] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.604244] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 861.604244] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.604244] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-557" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.604244] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-aac4511b-c3e4-44ce-8c77-1400d0526d22 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.604244] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.604244] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.604244] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.604244] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac4511b-c3e4-44ce-8c77-1400d0526d22',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.656464] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.746096] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 861.746180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.746667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.746667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.746795] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.747213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.747213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.747213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.747574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.747574] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.953138] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.107012] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.107321] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.107454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.107731] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.107884] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.108050] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port aac4511b-c3e4-44ce-8c77-1400d0526d22 not found, creating... [ 862.108320] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.108484] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.108607] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.108832] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.108987] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.109281] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.109441] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.109561] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.109770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.109908] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.110507] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: aac4511b-c3e4-44ce-8c77-1400d0526d22 is going to be created. [ 862.132853] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.133092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.133223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.133614] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.133849] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.134087] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.159114] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.159114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.159114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.159114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.159114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.159114] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b is going to be updated. [ 862.204975] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.205168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.205283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.205398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.205538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.217809] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: IN_PROGRESS for 2s [ 862.251421] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.315236] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 862.315440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.315616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.315987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.316090] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.316163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.316218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.316371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.316453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.316539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.316634] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.402052] env[62909]: INFO networking_nsxv3.common.synchronization [req-ec408719-407f-4b29-903f-e15ea3d683dc req-971b99a5-d154-40b2-89b7-003fea356f26 tempest-ServerActionsTestOtherB-1631848678 tempest-ServerActionsTestOtherB-1631848678-project-member] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 862.402278] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 862.402649] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.402809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.402888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.403201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.403415] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.403590] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.403688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.404085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.404202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.404327] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.457241] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.457388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.457477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.457668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.457757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.457853] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 862.500865] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.501071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.501071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.501278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.501497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.513333] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 862.755252] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.819430] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.819562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.819614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.819808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.819977] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.820092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.820158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.820309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.820424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.820544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.820706] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.820800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.820862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.821012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.821156] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.821336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.821336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.821435] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.821510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.821615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.821708] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.906167] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.906355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.906424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.906697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.929310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.931018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.931018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.931018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.931018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.931018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.931018] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 862.964721] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.964867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.965065] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.965161] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.965561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.977259] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 863.176187] env[62909]: INFO networking_nsxv3.common.synchronization [req-b3276513-5278-45fe-94a4-88d9db8b717c req-45bd5f70-b40c-4145-9798-24bc7e2b2f96 service nova] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 863.176346] env[62909]: INFO networking_nsxv3.common.synchronization [req-b3276513-5278-45fe-94a4-88d9db8b717c req-45bd5f70-b40c-4145-9798-24bc7e2b2f96 service nova] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 863.176466] env[62909]: INFO networking_nsxv3.common.synchronization [req-b3276513-5278-45fe-94a4-88d9db8b717c req-45bd5f70-b40c-4145-9798-24bc7e2b2f96 service nova] Enqueued Resource ID: aac4511b-c3e4-44ce-8c77-1400d0526d22 with Priority: HIGHEST for action port [ 863.176698] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 863.176834] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 863.176924] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aac4511b-c3e4-44ce-8c77-1400d0526d22 with Priority: HIGHEST for action port [ 863.179567] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.179567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.179567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.179567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.179567] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.181553] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.182026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.182026] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-aac4511b-c3e4-44ce-8c77-1400d0526d22 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.182026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.182243] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.182445] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.182558] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac4511b-c3e4-44ce-8c77-1400d0526d22',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.260028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.260028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.260028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.260028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.260028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.260028] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 863.329748] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3c6858c-f90d-4b04-bbda-341ff7525e29: rpc.has_security_group_logging(os_id): False [ 863.341595] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.341820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.341944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.344502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.344502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.353439] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.353612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.353733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.354016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.356103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.356103] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.356103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.356103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.356103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.356103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.356103] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.356103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.356103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.356103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.356103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.356787] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.356787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.356787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.356787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.356787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.357046] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 863.361405] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 863.435037] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.435037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.435037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.435037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.435037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.451144] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 863.685301] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.685301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.689533] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aac4511b-c3e4-44ce-8c77-1400d0526d22 with status ACTIVE [ 863.689761] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.689895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.689961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.690181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.690264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.690530] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.690626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.690688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.690841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.690913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.691111] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.691198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.691255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.693444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.693444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.693444] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aac4511b-c3e4-44ce-8c77-1400d0526d22 is going to be updated. [ 863.731383] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.731383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.731639] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.731902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.731950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.732133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.937746] env[62909]: INFO networking_nsxv3.common.synchronization [req-ae286c0b-4b2d-41bb-8a29-db1ec7cf8e61 req-881a4001-2763-43d7-94bb-57b4fce215c5 tempest-ListImageFiltersTestJSON-1708948366 tempest-ListImageFiltersTestJSON-1708948366-project-member] Enqueued Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 863.937746] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 863.938837] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.940829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.941068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.941490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.941826] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.942128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.942335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.942681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.942921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.943179] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.231695] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: SUCCESS [ 864.231916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.327078] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.327482] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.328615] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.329330] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.329330] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.330887] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.330887] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.330887] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.330887] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.330887] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.330887] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.331160] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.334022] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.334022] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.334022] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.334022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.354690] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.354885] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 864.355362] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.355362] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.355702] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-38e304a6-f447-44af-8c07-955d9d6a842f taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.355930] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-38e304a6-f447-44af-8c07-955d9d6a842f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.356073] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-38e304a6-f447-44af-8c07-955d9d6a842f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.356457] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-38e304a6-f447-44af-8c07-955d9d6a842f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.356630] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e304a6-f447-44af-8c07-955d9d6a842f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.446907] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.447096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.447170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.447388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.447477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.447733] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.447861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.447962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.448143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.448223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.448312] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb already deleted. [ 864.448507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.526298] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 864.526546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.527268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.527580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.527774] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.527891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.527956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.528353] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.528353] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.528353] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.860459] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.861059] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.861337] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.861773] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.864131] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.864131] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 38e304a6-f447-44af-8c07-955d9d6a842f not found, creating... [ 864.864131] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.864131] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.864131] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.864131] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.864131] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.868032] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.868032] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.868032] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.868032] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.868032] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.868032] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 38e304a6-f447-44af-8c07-955d9d6a842f is going to be created. [ 864.894883] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.895204] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.895271] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.895539] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.896960] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.897309] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-38e304a6-f447-44af-8c07-955d9d6a842f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.996445] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 864.996642] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a deletion is rescheduled due to dependency. [ 864.996642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.031413] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.373905] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 865.374736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.374736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.374736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.375207] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.375346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.375417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.375591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.375775] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.375775] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.375858] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.465680] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 865.465935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.533273] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.627925] env[62909]: INFO networking_nsxv3.common.synchronization [req-ae286c0b-4b2d-41bb-8a29-db1ec7cf8e61 req-d7ce555f-82a9-4630-83ce-6146c90972a2 service nova] Enqueued Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_rules [ 865.628187] env[62909]: INFO networking_nsxv3.common.synchronization [req-ae286c0b-4b2d-41bb-8a29-db1ec7cf8e61 req-d7ce555f-82a9-4630-83ce-6146c90972a2 service nova] Enqueued Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 865.628401] env[62909]: INFO networking_nsxv3.common.synchronization [req-ae286c0b-4b2d-41bb-8a29-db1ec7cf8e61 req-d7ce555f-82a9-4630-83ce-6146c90972a2 service nova] Enqueued Resource ID: 38e304a6-f447-44af-8c07-955d9d6a842f with Priority: HIGHEST for action port [ 865.628928] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_rules [ 865.629666] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 865.629888] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38e304a6-f447-44af-8c07-955d9d6a842f with Priority: HIGHEST for action port [ 865.630286] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.630773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.630773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.631051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.631165] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.632127] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.632312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.632421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.636308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.636496] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.636632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.636700] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.636904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.637557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.637739] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.638698] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-38e304a6-f447-44af-8c07-955d9d6a842f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.638835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38e304a6-f447-44af-8c07-955d9d6a842f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.638881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38e304a6-f447-44af-8c07-955d9d6a842f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.639069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38e304a6-f447-44af-8c07-955d9d6a842f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.639196] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e304a6-f447-44af-8c07-955d9d6a842f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.879616] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.880113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.880113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.880293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.880507] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.880668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.880735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.880898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.880987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.881093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.881243] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.882097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.882097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.882097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.882097] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.882097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.882097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.882097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.882097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.882435] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.882435] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.037205] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.037205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.037205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.037205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.037205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.037205] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 866.074018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.074018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.074018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.074018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.074018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.083070] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 866.141174] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.142526] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.142644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.144580] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38e304a6-f447-44af-8c07-955d9d6a842f with status ACTIVE [ 866.144580] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.144580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.144717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.144823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.145190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.145190] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.145190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.145350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.145574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.145665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.146743] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.147881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.147881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.147881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.147881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.147881] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38e304a6-f447-44af-8c07-955d9d6a842f is going to be updated. [ 866.171582] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.171739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.171789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.172024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.172147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.172311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38e304a6-f447-44af-8c07-955d9d6a842f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.387812] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57568fd4-ee2b-43e3-a228-9a168490f0f5: rpc.has_security_group_logging(os_id): False [ 866.417204] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.417447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.417503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.417789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.460108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.460108] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.460108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.460251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.460480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.460615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.460796] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.460910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.461026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.461205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.461281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.461467] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.461562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.461613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.461750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.461820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.461904] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 866.491674] env[62909]: INFO networking_nsxv3.common.synchronization [req-70739561-06ab-460e-9777-5cf164245f1e req-6cfd0a95-976b-48e1-81ea-29420f0d882d tempest-ListImageFiltersTestJSON-1708948366 tempest-ListImageFiltersTestJSON-1708948366-project-member] Enqueued Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 866.492129] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 866.492466] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.492609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.566351] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.566666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.567162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.567439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.567932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.590279] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 866.643623] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.127986] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.128198] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.128449] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.128736] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.129060] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.129740] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.129884] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.130126] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.130270] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.130549] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.130669] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.130807] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.130883] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.130997] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.131117] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.134638] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.142440] env[62909]: INFO networking_nsxv3.common.synchronization [req-a3f3d9e0-fabb-4ff4-97dd-29cb9f207bed req-0514d87f-23bd-4fcb-981d-e3ee43923565 tempest-MultipleCreateTestJSON-1768884473 tempest-MultipleCreateTestJSON-1768884473-project-member] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 867.143268] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 867.143268] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.143268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.143453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.143549] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.143668] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.143771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.143864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.148028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.148028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.148028] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.148028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.148028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.148028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.148028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.148028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.148028] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb is going to be created. [ 867.152987] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.152987] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.153136] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.153209] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-441" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.153524] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-cda3d580-68ab-4c88-9773-f8fb5b8394f2 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.153691] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-cda3d580-68ab-4c88-9773-f8fb5b8394f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.153823] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-cda3d580-68ab-4c88-9773-f8fb5b8394f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.154223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-cda3d580-68ab-4c88-9773-f8fb5b8394f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.154381] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cda3d580-68ab-4c88-9773-f8fb5b8394f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.175850] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.176034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.176086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.176318] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.176530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.225577] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: UNINITIALIZED for 2s [ 867.648630] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.662641] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.662882] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.663030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.663376] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.663547] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.663697] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port cda3d580-68ab-4c88-9773-f8fb5b8394f2 not found, creating... [ 867.663973] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.664148] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.664753] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.664753] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.664753] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.664970] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.665822] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.665822] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.665822] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.665822] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.665822] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: cda3d580-68ab-4c88-9773-f8fb5b8394f2 is going to be created. [ 867.690201] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.690467] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.690616] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.690960] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.691181] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.691507] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-cda3d580-68ab-4c88-9773-f8fb5b8394f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.094324] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 868.094324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.094496] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.094693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.094916] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.095043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.095110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.095299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.095383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.095481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.095573] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.152070] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.162091] env[62909]: INFO networking_nsxv3.common.synchronization [req-e3e0a111-666a-4e59-b420-5ca29e57a2c3 req-2b48c9a8-ecb5-4389-8b11-216bdb6e9eb6 tempest-MultipleCreateTestJSON-1768884473 tempest-MultipleCreateTestJSON-1768884473-project-member] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 868.163868] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 868.164956] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.164956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.597756] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.597921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.598038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.598368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.598547] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.598653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.598715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.598920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.599021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.599113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.599334] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.599436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.599504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.599694] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.599885] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.599971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.600034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.600332] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.600332] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.600530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.600530] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.607266] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 868.607347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.654565] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.654936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.655106] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.655458] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.655615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.655763] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 868.691504] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.691504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.691799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.691844] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.692266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.715950] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 869.085434] env[62909]: INFO networking_nsxv3.common.synchronization [req-70739561-06ab-460e-9777-5cf164245f1e req-cc562c65-731f-40a3-9054-13f07b61bc5b service nova] Enqueued Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_rules [ 869.085434] env[62909]: INFO networking_nsxv3.common.synchronization [req-70739561-06ab-460e-9777-5cf164245f1e req-cc562c65-731f-40a3-9054-13f07b61bc5b service nova] Enqueued Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 869.085434] env[62909]: INFO networking_nsxv3.common.synchronization [req-70739561-06ab-460e-9777-5cf164245f1e req-cc562c65-731f-40a3-9054-13f07b61bc5b service nova] Enqueued Resource ID: cda3d580-68ab-4c88-9773-f8fb5b8394f2 with Priority: HIGHEST for action port [ 869.085434] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_rules [ 869.085434] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 869.085434] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda3d580-68ab-4c88-9773-f8fb5b8394f2 with Priority: HIGHEST for action port [ 869.085434] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.085434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.085434] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.085434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.085434] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-cda3d580-68ab-4c88-9773-f8fb5b8394f2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.086503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cda3d580-68ab-4c88-9773-f8fb5b8394f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.086709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cda3d580-68ab-4c88-9773-f8fb5b8394f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.087098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cda3d580-68ab-4c88-9773-f8fb5b8394f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.087315] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cda3d580-68ab-4c88-9773-f8fb5b8394f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.104701] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e0b230b-d7d3-4c40-9cdd-92be876b4a05: rpc.has_security_group_logging(os_id): False [ 869.125704] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.125884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.125936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.126169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.150080] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.150371] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.150580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.150643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.150869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.150975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.151215] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.151346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.151416] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.151581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.151687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.151879] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.151971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.151971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.152399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.152482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.152581] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 869.221237] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.221498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.221498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.221818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.221966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.237649] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: SUCCESS [ 869.237649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.237649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.237649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.238039] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.240833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.240833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.240833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.240833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.240833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.240833] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.240833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.240833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.240833] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.241574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.241574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.241574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.241574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.241574] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.245299] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 869.596010] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cda3d580-68ab-4c88-9773-f8fb5b8394f2 with status ACTIVE [ 869.596321] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.596470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.596555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.596823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.596918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.597142] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.597233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.597294] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.597480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.597572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.597761] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.597880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.597942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.598096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.598200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.598251] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cda3d580-68ab-4c88-9773-f8fb5b8394f2 is going to be updated. [ 869.633881] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.634094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.634231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.634645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.634893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.635203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cda3d580-68ab-4c88-9773-f8fb5b8394f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.745644] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.745644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.745644] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.249014] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.727211] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 870.732017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.732017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.732017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.732017] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.732017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.732017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.732017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.732017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.732017] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.757600] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.757600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.757993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.757993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.758189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.758189] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb is going to be updated. [ 870.812048] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.812236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.812282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.812482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.812625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.825448] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: IN_PROGRESS for 2s [ 871.152350] env[62909]: INFO networking_nsxv3.common.synchronization [req-fb064d83-3020-4a49-916e-7d551f3a2846 req-ba5e070f-7af0-4d33-99d3-b54c79b21a4e tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 871.154865] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 871.155802] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.155802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.155802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.155802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.156043] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.156043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.156043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.156160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.156222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.156312] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.232961] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.233242] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.233313] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.233600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.233696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.233900] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.233996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.234089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.234257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.234368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.234511] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 871.276955] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 871.277193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.288020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.288150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.288238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.288897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.288897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.301352] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 871.660640] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.163946] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.170653] env[62909]: INFO networking_nsxv3.common.synchronization [req-8761a635-a784-4efd-a8a6-e395393feef9 req-44dee43d-7936-4e9f-b8c7-0ba616dbd6de tempest-ListServerFiltersTestJSON-403224292 tempest-ListServerFiltersTestJSON-403224292-project-member] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 872.171198] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 872.171563] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.173031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.173031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.173031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.177824] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.177824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.177824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.177824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.180183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.180183] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.484255] env[62909]: INFO networking_nsxv3.common.synchronization [req-5447acc1-e782-4a60-b970-4e56181da2ab req-dba9d226-4b1d-4192-b689-4b0fa02c0596 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_members [ 872.484445] env[62909]: INFO networking_nsxv3.common.synchronization [req-5447acc1-e782-4a60-b970-4e56181da2ab req-dba9d226-4b1d-4192-b689-4b0fa02c0596 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 872.485320] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_members [ 872.485452] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 872.487021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5afa51-af91-4a18-91ea-ad8cbadae183 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.487021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.487021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.487021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.487021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.487021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.487021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.487021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.487021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.488160] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.488756] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.488756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.488756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.488756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.489986] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.489986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.489986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.489986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.489986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.489986] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.565407] env[62909]: INFO networking_nsxv3.common.synchronization [req-5447acc1-e782-4a60-b970-4e56181da2ab req-dba9d226-4b1d-4192-b689-4b0fa02c0596 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 872.565605] env[62909]: INFO networking_nsxv3.common.synchronization [req-5447acc1-e782-4a60-b970-4e56181da2ab req-dba9d226-4b1d-4192-b689-4b0fa02c0596 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 872.565794] env[62909]: INFO networking_nsxv3.common.synchronization [req-5447acc1-e782-4a60-b970-4e56181da2ab req-dba9d226-4b1d-4192-b689-4b0fa02c0596 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_rules [ 872.565933] env[62909]: INFO networking_nsxv3.common.synchronization [req-5447acc1-e782-4a60-b970-4e56181da2ab req-dba9d226-4b1d-4192-b689-4b0fa02c0596 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_members [ 872.566169] env[62909]: INFO networking_nsxv3.common.synchronization [req-5447acc1-e782-4a60-b970-4e56181da2ab req-dba9d226-4b1d-4192-b689-4b0fa02c0596 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: aac4511b-c3e4-44ce-8c77-1400d0526d22 with Priority: HIGHEST for action port [ 872.566918] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 872.567082] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_rules [ 872.567213] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aac4511b-c3e4-44ce-8c77-1400d0526d22 with Priority: HIGHEST for action port [ 872.567311] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 872.567401] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_members [ 872.567683] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.567940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.567940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.568062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.568145] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.569118] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa5afa51-af91-4a18-91ea-ad8cbadae183 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.569439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.569439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.570296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.570384] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.571717] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-aac4511b-c3e4-44ce-8c77-1400d0526d22 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.571868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.571934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.572132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.572192] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac4511b-c3e4-44ce-8c77-1400d0526d22',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.576021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.576021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.576021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5afa51-af91-4a18-91ea-ad8cbadae183 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.576021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.668640] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.668871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.668871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.669196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.669345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.669474] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 872.681784] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.702020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.702226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.702265] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.702528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.702943] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.714865] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 872.837709] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: SUCCESS [ 872.837709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.837963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.838019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.838219] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.838342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.838404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.838572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.838657] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.838815] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.992030] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.992922] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.074883] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5afa51-af91-4a18-91ea-ad8cbadae183 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.076180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.076180] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.076180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.077690] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aac4511b-c3e4-44ce-8c77-1400d0526d22 with status ACTIVE [ 873.077866] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.077977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.078053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.078273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.078371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.078572] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.078663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.078775] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.079028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.079121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.079308] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.079408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.079459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.079592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.079668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.079734] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aac4511b-c3e4-44ce-8c77-1400d0526d22 is going to be updated. [ 873.101250] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.101502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.101502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.101850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.101850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.101982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.185272] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.313209] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 873.313650] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 deletion is rescheduled due to dependency. [ 873.313901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.343508] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.431159] env[62909]: INFO networking_nsxv3.common.synchronization [req-ab7dd62a-6aba-45d2-995b-0f6cd309130e req-fa164645-c2b2-451d-9820-0c93054939ba tempest-ServerMetadataTestJSON-819378476 tempest-ServerMetadataTestJSON-819378476-project-member] Enqueued Resource ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 with Priority: HIGHEST for action security_group_members [ 873.431268] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 with Priority: HIGHEST for action security_group_members [ 873.431676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.431809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.431888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.432677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.432854] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.432925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.433020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.433237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.433327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.433423] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d89bba3e-b2fe-4856-b21c-5154e1f55eb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.494564] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.498169] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.690952] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.691160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.692483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.692483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.692483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.692483] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be updated. [ 873.736150] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.736309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.736363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.736551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.736690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.747549] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 873.769817] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.769999] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-490" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.770135] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-490" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.770470] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-490" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.770730] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.770884] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.770998] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.771233] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.771375] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.771618] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.771734] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.771835] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.771940] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.772062] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 873.772181] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.772987] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.790784] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.790961] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 873.791117] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.791297] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-490" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.791774] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.791907] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.791962] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.792579] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.792579] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.845398] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.936332] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.936488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.936532] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.936750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.936845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.937072] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.937172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.937223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.937388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.937464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.937561] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 already deleted. [ 873.937643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.999129] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.999343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.999421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.999891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.999891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.999891] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 is going to be created. [ 874.001702] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.001831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.002017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.002081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.002168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.002257] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 874.027824] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.027824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.027824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.031303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.031303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.035889] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.036089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.036089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.036359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.036436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.038635] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: UNINITIALIZED for 2s [ 874.044099] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 874.296816] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.297318] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.297318] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.297536] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.297716] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.297850] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0 not found, creating... [ 874.298146] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.298330] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.298475] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.298720] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.298864] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.299193] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.299360] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.299481] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.299733] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.299875] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.300033] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0 is going to be created. [ 874.328673] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.328955] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.329117] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.329411] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.329719] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.329971] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.348057] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.348279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.348367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.348627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.348698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.348801] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb is going to be updated. [ 874.385634] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.385815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.385868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.386108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.386264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.403561] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: IN_PROGRESS for 2s [ 874.726448] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 874.726860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.087991] env[62909]: INFO networking_nsxv3.common.synchronization [req-ab7dd62a-6aba-45d2-995b-0f6cd309130e req-e985c68e-a0f8-4b1d-aff6-9232608be5c0 service nova] Enqueued Resource ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 with Priority: HIGHEST for action security_group_rules [ 875.087991] env[62909]: INFO networking_nsxv3.common.synchronization [req-ab7dd62a-6aba-45d2-995b-0f6cd309130e req-e985c68e-a0f8-4b1d-aff6-9232608be5c0 service nova] Enqueued Resource ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 with Priority: HIGHEST for action security_group_members [ 875.087991] env[62909]: INFO networking_nsxv3.common.synchronization [req-ab7dd62a-6aba-45d2-995b-0f6cd309130e req-e985c68e-a0f8-4b1d-aff6-9232608be5c0 service nova] Enqueued Resource ID: 1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0 with Priority: HIGHEST for action port [ 875.087991] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 with Priority: HIGHEST for action security_group_rules [ 875.087991] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 with Priority: HIGHEST for action security_group_members [ 875.087991] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0 with Priority: HIGHEST for action port [ 875.088478] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d89bba3e-b2fe-4856-b21c-5154e1f55eb5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.088594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.088687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.088909] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.088993] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d89bba3e-b2fe-4856-b21c-5154e1f55eb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.090303] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.091042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.091042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.091042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.091042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.091042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.091042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.091462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.091462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.091462] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d89bba3e-b2fe-4856-b21c-5154e1f55eb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.092080] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.092184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.092226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.092358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.092431] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.593940] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d89bba3e-b2fe-4856-b21c-5154e1f55eb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.595497] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.595497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.595656] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0 with status ACTIVE [ 875.596399] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.596399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.596399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.596399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.596399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.596659] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.596659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.596659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.596910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.596910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.597078] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.597198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.597261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.597412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.597468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.597534] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0 is going to be updated. [ 875.619786] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.619986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.619986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.620234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.620376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.620622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f51697b-7d1f-4979-85b5-8e3b0ccc5fe0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.758737] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 875.758955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.049822] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: SUCCESS [ 876.050337] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.050665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.052524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.052524] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.052524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.052524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.052524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.052524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.052524] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.054772] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 876.055209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.055514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.057538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.057538] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.057538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.057538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.057538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.057538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.057538] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.100915] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d89bba3e-b2fe-4856-b21c-5154e1f55eb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.102263] env[62909]: INFO networking_nsxv3.common.synchronization [req-16fe1705-c242-47e2-ba02-8c43dda12d4c req-17f575a7-e6c8-4b1b-a937-637605d45e43 tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 876.106021] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 876.106021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.106021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.106021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.106021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.106021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.106021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.106021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.106021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.106021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.106021] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.423885] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: SUCCESS [ 876.424196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.424378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.424937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.424937] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.425105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.425105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.426030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.426030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.426030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.426030] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.426030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.426030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.426030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.426428] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.426428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.426428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.426559] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.426589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.426661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.426803] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.558959] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.560164] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.581339] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.582183] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-121" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.582448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-121" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.582866] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-121" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.583183] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.583382] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.583518] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.583847] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.584031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.584307] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.584463] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.584620] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.584764] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.584920] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.585065] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.585211] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.603994] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.604405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.604405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.604710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.604710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.604710] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 is going to be created. [ 876.606880] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.611171] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 876.611393] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.611717] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-121" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.612075] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-3dc57e52-6e86-4d59-bf3e-c46b60446825 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.612289] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.612388] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.612712] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.613058] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc57e52-6e86-4d59-bf3e-c46b60446825',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.614132] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.615044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.615044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.615150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.615240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.615419] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.615542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.615582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.615820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.615879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.615982] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05b8610-e099-492a-a795-e90ed01da010 already deleted. [ 876.616078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.640475] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.640645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.640698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.640903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.641106] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.652112] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 in Status: UNINITIALIZED for 2s [ 876.934105] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb: rpc.has_security_group_logging(os_id): False [ 876.953282] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.953282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.953412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.953579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.953724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.953979] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.954129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.954199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.954383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.954465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.954684] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.954784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.954845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.954994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.955136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.955300] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.955395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.955455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.955596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.955666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.955790] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb is going to be created. [ 877.062763] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.064101] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.070598] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.070732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.070732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.071513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.071513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.084915] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: IN_PROGRESS for 2s [ 877.117666] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.117666] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.117879] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.118279] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.118598] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.118981] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 3dc57e52-6e86-4d59-bf3e-c46b60446825 not found, creating... [ 877.119098] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.119243] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.119390] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.119610] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.119754] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.120072] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.120237] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.120361] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.120660] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.120808] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.120996] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 3dc57e52-6e86-4d59-bf3e-c46b60446825 is going to be created. [ 877.144946] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.145439] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.145439] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.145726] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.146065] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.146252] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.568634] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.569544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.569715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.570983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.570983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.570983] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 is going to be updated. [ 877.573954] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.573954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.573954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.573954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.573954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.573954] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 877.608566] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.608961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.608961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.609062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.609200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.611041] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.611246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.611373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.611628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.611776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.623725] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 877.624745] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: IN_PROGRESS for 2s [ 877.896230] env[62909]: INFO networking_nsxv3.common.synchronization [req-16fe1705-c242-47e2-ba02-8c43dda12d4c req-2751f995-512b-4c66-a81e-7d4655215b6e service nova] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_rules [ 877.896449] env[62909]: INFO networking_nsxv3.common.synchronization [req-16fe1705-c242-47e2-ba02-8c43dda12d4c req-2751f995-512b-4c66-a81e-7d4655215b6e service nova] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 877.896569] env[62909]: INFO networking_nsxv3.common.synchronization [req-16fe1705-c242-47e2-ba02-8c43dda12d4c req-2751f995-512b-4c66-a81e-7d4655215b6e service nova] Enqueued Resource ID: 3dc57e52-6e86-4d59-bf3e-c46b60446825 with Priority: HIGHEST for action port [ 877.896813] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_rules [ 877.896940] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 877.897094] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc57e52-6e86-4d59-bf3e-c46b60446825 with Priority: HIGHEST for action port [ 877.897582] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.897720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.897788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.897981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.898076] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.899309] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.899373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.899460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.900088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.900088] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.900088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.900088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.900088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.900335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.900335] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.901221] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dc57e52-6e86-4d59-bf3e-c46b60446825 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.901221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.901221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.901356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.901356] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc57e52-6e86-4d59-bf3e-c46b60446825',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.402910] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.403072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.404376] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.405284] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dc57e52-6e86-4d59-bf3e-c46b60446825 with status ACTIVE [ 878.405437] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.405545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.405607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.406315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.406315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.406315] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.406315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.406315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.406621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.406621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.406621] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.406737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.406737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.406881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.406930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.407011] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dc57e52-6e86-4d59-bf3e-c46b60446825 is going to be updated. [ 878.430359] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.430600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.430649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.430827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.430967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.431141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.662268] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 in Status: SUCCESS [ 878.662599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.662694] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.662878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.663087] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.663206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.663269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.663427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.663509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.663597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.663687] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d89bba3e-b2fe-4856-b21c-5154e1f55eb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.830832] env[62909]: INFO networking_nsxv3.common.synchronization [None req-60aacc7f-ca72-430a-95a5-ebf8c8d411ea tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_rules [ 878.830832] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_rules [ 878.830832] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.831636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.831801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.832173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.832492] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.912253] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.966702] env[62909]: INFO networking_nsxv3.common.synchronization [None req-eca2219f-664c-494f-bef1-59862a8a6922 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_rules [ 878.967235] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_rules [ 878.967540] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.967650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.097074] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: SUCCESS [ 879.097305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.097847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.098074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.098153] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.165918] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.166246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.166246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.167038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.167038] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.167038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.167038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.167038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.167283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.167283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.167337] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.167378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.167487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.167582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.167725] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.167837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.167929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.167996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.168078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.168146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.168230] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d89bba3e-b2fe-4856-b21c-5154e1f55eb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.354514] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.354698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.354752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.354955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.355059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.355158] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 already deleted. [ 879.355258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.355394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.355562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.355641] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.414426] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.414683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.414683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.414854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.414946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.415098] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05b8610-e099-492a-a795-e90ed01da010 is going to be created. [ 879.441286] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.441516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.441516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.441746] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.441911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.452105] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: UNINITIALIZED for 2s [ 879.600678] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.600948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.600948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.601146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.601326] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.601432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.601512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.601679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.601767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.601857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.601945] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.635924] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: SUCCESS [ 879.636603] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.636697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.638103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.638238] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.638390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.638490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.638679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.638770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.638866] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.639283] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.641091] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 879.641364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.641590] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.641983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.642079] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.642189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.642189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.642341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.642415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.642497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.642586] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.672371] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d89bba3e-b2fe-4856-b21c-5154e1f55eb5: rpc.has_security_group_logging(os_id): False [ 879.695164] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.695164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.695164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.695164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.695164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.695365] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.695365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.695365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.696025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.696025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.696025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.696025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.696025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.696284] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.696284] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.696442] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.696536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.696595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.696733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.696808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.696894] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 is going to be created. [ 879.775246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.775477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.775477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.775769] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.776012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.791529] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 in Status: IN_PROGRESS for 2s [ 879.884940] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.885184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.885232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.885456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.885545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.885645] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 already deleted. [ 879.885727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.953651] env[62909]: INFO networking_nsxv3.common.synchronization [req-18ae4212-3f63-4d08-b9ad-fde101fcc292 req-ed23ca8a-86d5-40a1-be8b-31f91f76057a tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 with Priority: HIGHEST for action security_group_members [ 879.953820] env[62909]: INFO networking_nsxv3.common.synchronization [req-18ae4212-3f63-4d08-b9ad-fde101fcc292 req-ed23ca8a-86d5-40a1-be8b-31f91f76057a tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_members [ 879.953960] env[62909]: INFO networking_nsxv3.common.synchronization [req-18ae4212-3f63-4d08-b9ad-fde101fcc292 req-ed23ca8a-86d5-40a1-be8b-31f91f76057a tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 879.954659] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 with Priority: HIGHEST for action security_group_members [ 879.954798] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_members [ 879.954894] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 879.955177] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-38c23fdc-792b-42e3-ba30-dd0db605dda2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.955324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.955364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.955610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.955767] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.955861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.955923] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.956090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.956255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.956255] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38c23fdc-792b-42e3-ba30-dd0db605dda2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.957186] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5afa51-af91-4a18-91ea-ad8cbadae183 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.957186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.957313] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.957397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.957542] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.957692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.957772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.957913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.957993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.958154] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.958892] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.959219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.959219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.959660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.959814] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.960423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.960771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.960771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.960771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.960891] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.022155] env[62909]: INFO networking_nsxv3.common.synchronization [req-18ae4212-3f63-4d08-b9ad-fde101fcc292 req-ed23ca8a-86d5-40a1-be8b-31f91f76057a tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 with Priority: HIGHEST for action security_group_rules [ 880.022812] env[62909]: INFO networking_nsxv3.common.synchronization [req-18ae4212-3f63-4d08-b9ad-fde101fcc292 req-ed23ca8a-86d5-40a1-be8b-31f91f76057a tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 with Priority: HIGHEST for action security_group_members [ 880.023347] env[62909]: INFO networking_nsxv3.common.synchronization [req-18ae4212-3f63-4d08-b9ad-fde101fcc292 req-ed23ca8a-86d5-40a1-be8b-31f91f76057a tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 880.023629] env[62909]: INFO networking_nsxv3.common.synchronization [req-18ae4212-3f63-4d08-b9ad-fde101fcc292 req-ed23ca8a-86d5-40a1-be8b-31f91f76057a tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 880.031364] env[62909]: INFO networking_nsxv3.common.synchronization [req-18ae4212-3f63-4d08-b9ad-fde101fcc292 req-ed23ca8a-86d5-40a1-be8b-31f91f76057a tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_rules [ 880.031364] env[62909]: INFO networking_nsxv3.common.synchronization [req-18ae4212-3f63-4d08-b9ad-fde101fcc292 req-ed23ca8a-86d5-40a1-be8b-31f91f76057a tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_members [ 880.031364] env[62909]: INFO networking_nsxv3.common.synchronization [req-18ae4212-3f63-4d08-b9ad-fde101fcc292 req-ed23ca8a-86d5-40a1-be8b-31f91f76057a tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: aac4511b-c3e4-44ce-8c77-1400d0526d22 with Priority: HIGHEST for action port [ 880.031364] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 with Priority: HIGHEST for action security_group_rules [ 880.031364] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_rules [ 880.031364] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_members [ 880.031364] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aac4511b-c3e4-44ce-8c77-1400d0526d22 with Priority: HIGHEST for action port [ 880.031364] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_rules [ 880.031364] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 with Priority: HIGHEST for action security_group_members [ 880.031364] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 880.033299] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38c23fdc-792b-42e3-ba30-dd0db605dda2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.033440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.033503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.033759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.033853] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38c23fdc-792b-42e3-ba30-dd0db605dda2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.034765] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.034880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.035053] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5afa51-af91-4a18-91ea-ad8cbadae183 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.035133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.035316] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-aac4511b-c3e4-44ce-8c77-1400d0526d22 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.035437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.035501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.035671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.035776] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac4511b-c3e4-44ce-8c77-1400d0526d22',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.036766] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa5afa51-af91-4a18-91ea-ad8cbadae183 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.036868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.037076] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-38c23fdc-792b-42e3-ba30-dd0db605dda2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.037162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.037344] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.037424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.104607] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.104839] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.104893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.105145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.105329] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.105437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.105502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.105656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.105744] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.105870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.106050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.106147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.106208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.106352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.106522] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.106619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.106680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.106816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.106892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.106973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.107072] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.145467] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.146241] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.146384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.463410] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.464387] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38c23fdc-792b-42e3-ba30-dd0db605dda2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.465154] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.538955] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-38c23fdc-792b-42e3-ba30-dd0db605dda2 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.539220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.539316] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aac4511b-c3e4-44ce-8c77-1400d0526d22 with status ACTIVE [ 880.539490] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.539664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.539737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.539969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.540080] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.540286] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.540387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.540453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.540674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.540751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.540931] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.541034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.541091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.541218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.541289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.541375] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aac4511b-c3e4-44ce-8c77-1400d0526d22 is going to be updated. [ 880.567355] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.567591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.567591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.567771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.567915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.568095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aac4511b-c3e4-44ce-8c77-1400d0526d22" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.609963] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb: rpc.has_security_group_logging(os_id): False [ 880.631036] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.631208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.631208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.631685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.631685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.631815] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.631961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.631994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.632157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.632259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.632514] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.632621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.632681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.633059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.633059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.633635] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.633763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.633844] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.634017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.634112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.634341] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb is going to be updated. [ 880.647216] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa5afa51-af91-4a18-91ea-ad8cbadae183: rpc.has_security_group_logging(os_id): False [ 880.685761] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.685761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.685761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.686247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.686247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.686594] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.686594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.687290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.687290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.687290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.687290] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 is going to be created. [ 880.774160] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.774281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.774359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.774555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.774700] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.776626] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.776747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.776820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.777009] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.777181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.817987] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: IN_PROGRESS for 2s [ 880.821745] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: IN_PROGRESS for 2s [ 880.968279] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38c23fdc-792b-42e3-ba30-dd0db605dda2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.968279] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.968555] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.053315] env[62909]: INFO networking_nsxv3.common.synchronization [req-63b6f399-1421-4fe2-8ece-6d2376104316 req-8f2812d8-7475-457c-8c04-01f254ff1137 tempest-ServersNegativeTestJSON-170677023 tempest-ServersNegativeTestJSON-170677023-project-member] Enqueued Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 881.055953] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 881.055953] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.055953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.055953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.055953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.055953] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.055953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.055953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.055953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.055953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.055953] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.400488] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-65 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.400633] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.400741] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.401219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.401506] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.401668] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.401785] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.402051] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.402202] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.402413] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.402524] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.402633] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.402741] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.402849] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.402954] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.403105] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.434027] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.434027] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 881.434027] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.434027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.434027] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-00706251-f634-4dcb-9705-105152de241f taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.434027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.434027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.436339] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.436339] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00706251-f634-4dcb-9705-105152de241f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.463483] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: SUCCESS [ 881.463483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.463483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.463631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.463765] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.464481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.464481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.464481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.464481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.464481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.464481] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.470102] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.470300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.470374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.470630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.470715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.470810] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 is going to be created. [ 881.472086] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.472203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.472278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.472449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.472532] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.472638] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 is going to be updated. [ 881.474315] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.474459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.474537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.474710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.474796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.474883] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 881.507711] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.507822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.507891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.508117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.508282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.525304] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.525713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.525904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.526147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.526322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.532870] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 in Status: UNINITIALIZED for 2s [ 881.535203] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.535336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.539035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.539035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.539035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.558731] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: IN_PROGRESS for 2s [ 881.559103] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.559236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.559307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.559888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.559994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.560437] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.560437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.560437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.560663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.560725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.560813] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd already deleted. [ 881.560893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.562493] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 881.807983] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 in Status: SUCCESS [ 881.808248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.940024] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.940480] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.940727] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.941279] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.941477] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.941736] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 00706251-f634-4dcb-9705-105152de241f not found, creating... [ 881.943929] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.944213] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.944317] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.944589] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.944737] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.945089] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.945309] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.945375] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.945605] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.945749] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.945895] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 00706251-f634-4dcb-9705-105152de241f is going to be created. [ 881.967517] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.975355] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.975355] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.975355] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.975355] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.975355] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.975355] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.470166] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a05b8610-e099-492a-a795-e90ed01da010: rpc.has_security_group_logging(os_id): False [ 882.490060] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.490252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.490360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.490719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.490863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.491233] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.491569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.491693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.491963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.492085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.492204] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a05b8610-e099-492a-a795-e90ed01da010 is going to be created. [ 882.570461] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.570863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.570863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.571033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.571302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.583955] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: IN_PROGRESS for 2s [ 882.831222] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: SUCCESS [ 882.831580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.831921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.832339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.832459] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.834056] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: SUCCESS [ 882.834251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.170213] env[62909]: INFO networking_nsxv3.common.synchronization [req-63b6f399-1421-4fe2-8ece-6d2376104316 req-be812aef-c572-462c-9045-5bc3458a2773 service nova] Enqueued Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_rules [ 883.170388] env[62909]: INFO networking_nsxv3.common.synchronization [req-63b6f399-1421-4fe2-8ece-6d2376104316 req-be812aef-c572-462c-9045-5bc3458a2773 service nova] Enqueued Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 883.170604] env[62909]: INFO networking_nsxv3.common.synchronization [req-63b6f399-1421-4fe2-8ece-6d2376104316 req-be812aef-c572-462c-9045-5bc3458a2773 service nova] Enqueued Resource ID: 00706251-f634-4dcb-9705-105152de241f with Priority: HIGHEST for action port [ 883.170882] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_rules [ 883.171015] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 883.171135] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00706251-f634-4dcb-9705-105152de241f with Priority: HIGHEST for action port [ 883.171701] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.171898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.171898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.172660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.172749] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.176500] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.177039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.177039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.177039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.177272] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.177422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.177495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.177664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.177751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.177842] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.178848] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-00706251-f634-4dcb-9705-105152de241f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.179064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.180081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.180268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.180351] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00706251-f634-4dcb-9705-105152de241f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.335909] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5afa51-af91-4a18-91ea-ad8cbadae183 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.336131] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.408222] env[62909]: INFO networking_nsxv3.common.synchronization [req-f550be54-8adc-4b86-94d8-ff79f220cb3c req-599849fe-4d7a-423e-98d0-1113b4fb6b84 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 with Priority: HIGHEST for action security_group_members [ 883.408419] env[62909]: INFO networking_nsxv3.common.synchronization [req-f550be54-8adc-4b86-94d8-ff79f220cb3c req-599849fe-4d7a-423e-98d0-1113b4fb6b84 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_members [ 883.408608] env[62909]: INFO networking_nsxv3.common.synchronization [req-f550be54-8adc-4b86-94d8-ff79f220cb3c req-599849fe-4d7a-423e-98d0-1113b4fb6b84 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 883.409136] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 with Priority: HIGHEST for action security_group_members [ 883.409298] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGHEST for action security_group_members [ 883.409400] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 883.409721] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-38c23fdc-792b-42e3-ba30-dd0db605dda2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.409827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.412889] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5afa51-af91-4a18-91ea-ad8cbadae183 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.413168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.413348] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.413417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.544188] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 in Status: SUCCESS [ 883.544428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.544595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.544826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.545029] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.545157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.545239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.545415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.545496] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.545597] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38c23fdc-792b-42e3-ba30-dd0db605dda2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.570764] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: SUCCESS [ 883.571049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.571235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.571524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.571872] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.571965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.572054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.572356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.572412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.572552] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.574289] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 883.574530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.574991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.575219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.575428] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.575581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.575689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.575897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.575965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.576044] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.683853] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.685161] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.685310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.685649] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00706251-f634-4dcb-9705-105152de241f with status ACTIVE [ 883.685934] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.686102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.686175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.686396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.686488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.687282] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.687509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.687547] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.687718] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.687877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.688367] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.688367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.688367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.688601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.688683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.688717] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00706251-f634-4dcb-9705-105152de241f is going to be updated. [ 883.712228] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.712384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.712437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.712635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.712783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.713012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.048202] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.048546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.048546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.048715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.048796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.048987] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.049107] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.049148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.049290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.049372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.049442] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 is going to be deleted. [ 884.079326] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.079487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.080051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.080051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.080051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.080330] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.080330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.080422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.080570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.080656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.080743] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 is going to be updated. [ 884.083535] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.086558] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.086558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.086558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.086558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.086825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.086825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.086825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.089075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.089075] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.089075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.089075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.089075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.089075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.089075] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38c23fdc-792b-42e3-ba30-dd0db605dda2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.116144] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.116144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.116144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.116144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.116144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.125518] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: IN_PROGRESS for 2s [ 884.188273] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.585819] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.589416] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.589600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.589677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.589910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.590030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.590235] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.590333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.590396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.590612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.590691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.590778] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 already deleted. [ 884.590856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.590951] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38c23fdc-792b-42e3-ba30-dd0db605dda2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.591787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.591951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.592115] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.592232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.592277] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.592415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.592493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.592579] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38c23fdc-792b-42e3-ba30-dd0db605dda2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.596422] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: SUCCESS [ 884.597421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.690352] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.690575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.690667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.690890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.690980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.691105] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd is going to be created. [ 884.718142] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.718142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.718142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.718142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.718443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.728654] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: UNINITIALIZED for 2s [ 885.088481] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.088902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.089055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.089211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.089319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.089402] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 885.094538] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38c23fdc-792b-42e3-ba30-dd0db605dda2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.095700] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.095838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.096073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.096196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.096294] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.096480] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.096579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.096644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.096798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.096885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.096971] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 already deleted. [ 885.097064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.134432] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.134581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.134581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.134772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.134993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.145888] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 885.598299] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38c23fdc-792b-42e3-ba30-dd0db605dda2: rpc.has_security_group_logging(os_id): False [ 885.620835] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.621051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.621095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.621358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.621482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.621780] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.621903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.621970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.623370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.623482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.623605] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 is going to be created. [ 885.645645] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/38c23fdc-792b-42e3-ba30-dd0db605dda2], does not exist path=[/infra/domains/default/groups/38c23fdc-792b-42e3-ba30-dd0db605dda2]."\n}' [ 885.645851] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/38c23fdc-792b-42e3-ba30-dd0db605dda2 [ 885.645971] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 885.688883] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.689224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.689224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.689472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.691105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.691551] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.691749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.691833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.692156] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.692281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.692681] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.692935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.693022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.693219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.693325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.693464] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38c23fdc-792b-42e3-ba30-dd0db605dda2 is going to be created. [ 885.715248] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/38c23fdc-792b-42e3-ba30-dd0db605dda2], does not exist path=[/infra/domains/default/groups/38c23fdc-792b-42e3-ba30-dd0db605dda2]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/38c23fdc-792b-42e3-ba30-dd0db605dda2 [ 885.715442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38c23fdc-792b-42e3-ba30-dd0db605dda2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.715691] env[62909]: Traceback (most recent call last): [ 885.715728] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 885.715728] env[62909]: return func(*args, **kwargs) [ 885.715728] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 885.715728] env[62909]: res.raise_for_status() [ 885.715728] env[62909]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 885.715728] env[62909]: raise HTTPError(http_error_msg, response=self) [ 885.715728] env[62909]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/38c23fdc-792b-42e3-ba30-dd0db605dda2 [ 885.715728] env[62909]: During handling of the above exception, another exception occurred: [ 885.715728] env[62909]: Traceback (most recent call last): [ 885.715996] env[62909]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 885.715996] env[62909]: listener.cb(fileno) [ 885.715996] env[62909]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 265, in main [ 885.715996] env[62909]: result = function(*args, **kwargs) [ 885.715996] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 885.715996] env[62909]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 885.715996] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 885.715996] env[62909]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 885.715996] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 885.715996] env[62909]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 885.715996] env[62909]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 885.715996] env[62909]: res.raise_for_status() [ 885.715996] env[62909]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 885.715996] env[62909]: raise HTTPError(http_error_msg, response=self) [ 885.715996] env[62909]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/38c23fdc-792b-42e3-ba30-dd0db605dda2 [ 885.715996] env[62909]: Removing descriptor: 63 [ 886.136039] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: SUCCESS [ 886.136411] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 deletion is rescheduled due to dependency. [ 886.136411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.136982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.136982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.136982] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.137225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.137225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.137429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.137479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.137546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.137650] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.139080] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.139235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.139485] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.139737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.139816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.140054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.140188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.140307] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.454140] env[62909]: INFO networking_nsxv3.common.synchronization [req-20811085-382d-4f8d-8529-edfc38f3e907 req-333794c3-9585-44d1-b077-31815c94d67c tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 886.454140] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 886.454140] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.454140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.454140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.454140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.454140] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.454140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.454140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.455323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.455582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.456438] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.642027] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.643696] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.643841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.643841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.644089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.665443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.665764] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.665926] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.666077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.666361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.666496] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.666623] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 is going to be updated. [ 886.692261] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.692392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.692464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.692673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.692824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.709108] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: IN_PROGRESS for 2s [ 886.743049] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: SUCCESS [ 886.743049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.743049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.743049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.743049] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.743049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.743049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.743049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.743049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.743049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.743049] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.799454] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.799864] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.799864] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.800141] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.800408] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.800687] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.800748] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.800996] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.801842] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.801966] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.802110] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.802215] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.802387] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.802589] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.802766] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.802938] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.838540] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.838746] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 886.838904] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.839123] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.839466] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-23732df6-58dd-4637-9c04-c25d6b049c91 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.839700] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-23732df6-58dd-4637-9c04-c25d6b049c91" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.840174] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-23732df6-58dd-4637-9c04-c25d6b049c91" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.840540] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-23732df6-58dd-4637-9c04-c25d6b049c91" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.841200] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23732df6-58dd-4637-9c04-c25d6b049c91',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.963667] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.963667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.963667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.963667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.963667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.963667] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.963667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.963667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.963667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.963667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.963667] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 already deleted. [ 886.963667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.107148] env[62909]: INFO networking_nsxv3.common.synchronization [req-e3723296-b128-4fe9-bd04-421a95937481 req-b475d63e-0e6a-4821-b8a6-481efc5792f7 tempest-ServerMetadataTestJSON-819378476 tempest-ServerMetadataTestJSON-819378476-project-member] Enqueued Resource ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 with Priority: HIGHEST for action security_group_members [ 887.107745] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 with Priority: HIGHEST for action security_group_members [ 887.108074] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.108189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.108253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.108471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.111993] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.111993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.111993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.111993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.111993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.111993] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d89bba3e-b2fe-4856-b21c-5154e1f55eb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.146398] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa5afa51-af91-4a18-91ea-ad8cbadae183: rpc.has_security_group_logging(os_id): False [ 887.168622] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 887.168851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.169565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.169768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.170011] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.170191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.170267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.170468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.170618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.170712] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.170939] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.171222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.171304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.171486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.171703] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.171823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.171885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.172052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.172131] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.172211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.172299] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.173501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.173593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.173755] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.173866] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.173932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.174116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.174211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.174284] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.183361] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.183361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.183361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.183361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.183361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.183361] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.183361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.183361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.183361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.183361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.185119] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 is going to be updated. [ 887.248645] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.248868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.248940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.249191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.249418] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.249604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.249650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.249823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.249915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.250011] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.250258] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.250354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.250419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.250632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.250797] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.254641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.254641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.254641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.254641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.254641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.254641] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.273592] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.273759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.273846] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.274089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.274412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.295076] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: IN_PROGRESS for 2s [ 887.347540] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.347791] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.347981] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.348316] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.348575] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.348782] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 23732df6-58dd-4637-9c04-c25d6b049c91 not found, creating... [ 887.349109] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.349307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.349524] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.349866] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.350047] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.350373] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.350593] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.350743] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.350987] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.351163] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.351322] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 23732df6-58dd-4637-9c04-c25d6b049c91 is going to be created. [ 887.378990] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.379255] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.379388] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.379691] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.380067] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.380393] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-23732df6-58dd-4637-9c04-c25d6b049c91" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.614050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.614283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.614399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.614667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.636427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.636809] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.636956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.637075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.637366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.637483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.637582] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 is going to be updated. [ 887.668373] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.668585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.668645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.668854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.669018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.675768] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e0b230b-d7d3-4c40-9cdd-92be876b4a05: rpc.has_security_group_logging(os_id): False [ 887.676805] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.679074] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 in Status: IN_PROGRESS for 2s [ 887.697168] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.697361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.697448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.697702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.723526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.723905] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.724095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.724195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.724472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.724597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.725301] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.725301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.725301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.725301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.725622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.725622] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.725916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.725916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.726041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.726122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.726215] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 887.753445] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f28a45c0-8394-4cec-b3b7-949be46fb2dd: rpc.has_security_group_logging(os_id): False [ 887.774373] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.774571] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.774632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.774818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.774907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.775148] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.775252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.775316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.775474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.775597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.775742] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.775836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.775893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.776155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.776155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.776349] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.776408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.776438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.776574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.776647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.776748] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd is going to be created. [ 887.812516] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.812652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.812708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.812958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.813123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.832876] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 887.873041] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.873041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.873041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.873041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.873041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.888058] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: IN_PROGRESS for 2s [ 888.108127] env[62909]: INFO networking_nsxv3.common.synchronization [req-20811085-382d-4f8d-8529-edfc38f3e907 req-e295bd41-9000-4749-818b-227db9fb04c6 service nova] Enqueued Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_rules [ 888.108127] env[62909]: INFO networking_nsxv3.common.synchronization [req-20811085-382d-4f8d-8529-edfc38f3e907 req-e295bd41-9000-4749-818b-227db9fb04c6 service nova] Enqueued Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 888.108228] env[62909]: INFO networking_nsxv3.common.synchronization [req-20811085-382d-4f8d-8529-edfc38f3e907 req-e295bd41-9000-4749-818b-227db9fb04c6 service nova] Enqueued Resource ID: 23732df6-58dd-4637-9c04-c25d6b049c91 with Priority: HIGHEST for action port [ 888.108480] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_rules [ 888.108594] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 888.108708] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23732df6-58dd-4637-9c04-c25d6b049c91 with Priority: HIGHEST for action port [ 888.109288] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.109411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.109479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.109674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.110943] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.111461] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.111461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.111461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.111461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.111636] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.111636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.111711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.111899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.111899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.112035] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.112816] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-23732df6-58dd-4637-9c04-c25d6b049c91 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.112947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23732df6-58dd-4637-9c04-c25d6b049c91" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.113024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23732df6-58dd-4637-9c04-c25d6b049c91" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.113175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23732df6-58dd-4637-9c04-c25d6b049c91" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.113247] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23732df6-58dd-4637-9c04-c25d6b049c91',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.180448] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.615145] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.620264] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.620396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.620929] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23732df6-58dd-4637-9c04-c25d6b049c91 with status ACTIVE [ 888.621220] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.621358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.621426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.621691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.621806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.621994] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.623079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.623183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.623331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.623448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.623647] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.623763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.623826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.624016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.624098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.624212] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23732df6-58dd-4637-9c04-c25d6b049c91 is going to be updated. [ 888.646355] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.646571] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.646571] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.646870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.646952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.647083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23732df6-58dd-4637-9c04-c25d6b049c91" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.683272] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.683659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.683771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.684021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.684140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.684256] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 888.719550] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.719764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.719828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.720051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.720206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.733991] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: SUCCESS [ 888.734154] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 deletion is rescheduled due to dependency. [ 888.734225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.735572] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 889.121402] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.308798] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 in Status: SUCCESS [ 889.309191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.593604] env[62909]: INFO networking_nsxv3.common.synchronization [req-23afa176-23f6-40ec-a3ca-95fcf944415d req-48db4a21-baaa-4e9f-b580-e5618b76545d tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 889.594146] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 889.594448] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.596770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.596770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.596770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.597321] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.597445] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.597511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.597702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.597774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.597869] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.627333] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.627503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.627554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.628620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.628620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.628620] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 is going to be created. [ 889.656735] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.657383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.658065] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.658310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.658513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.670677] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: UNINITIALIZED for 2s [ 889.687171] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 in Status: SUCCESS [ 889.687716] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 deletion is rescheduled due to dependency. [ 889.687885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.852289] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 889.852392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.853020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.853329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.853329] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.903045] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: SUCCESS [ 889.903350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.100334] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.100494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.100494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.100765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.127315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.127753] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.127894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.127982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.128180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.128264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.128356] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 890.138356] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.138605] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.138830] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.139026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.139433] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.139599] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.139722] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.139986] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.142709] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.143060] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.143205] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.143323] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.143440] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.143756] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.143756] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.143895] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.172287] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.172436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.172535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.172820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.172940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.175207] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.175375] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.175509] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.175695] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.176040] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-9be7ced3-94cd-47b2-8902-92429978705c taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.176368] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-9be7ced3-94cd-47b2-8902-92429978705c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.176368] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-9be7ced3-94cd-47b2-8902-92429978705c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.176679] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-9be7ced3-94cd-47b2-8902-92429978705c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.176873] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9be7ced3-94cd-47b2-8902-92429978705c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.185234] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 890.357486] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.357486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.680307] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.680589] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.680739] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.681150] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.681327] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.681701] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 9be7ced3-94cd-47b2-8902-92429978705c not found, creating... [ 890.681809] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.682670] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.682670] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.682670] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.682670] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.682972] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.683199] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.683373] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.683615] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.683786] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.683931] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 9be7ced3-94cd-47b2-8902-92429978705c is going to be created. [ 890.706814] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.706814] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.707070] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.707837] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.707837] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.708071] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-9be7ced3-94cd-47b2-8902-92429978705c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.747559] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 890.747874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.748118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.748332] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.748525] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.748642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.748707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.748873] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.748954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.749050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.749146] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.251707] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.251945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.252035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.252275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.252491] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.252555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.252622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.252779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.252928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.253040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.253197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.253289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.253350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.253492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.253631] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.253722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.253780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.253964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.254079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.254079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.254167] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.391100] env[62909]: INFO networking_nsxv3.common.synchronization [req-23afa176-23f6-40ec-a3ca-95fcf944415d req-eb2d3eff-6b70-4f89-b2bb-8aeaa615c9b8 service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 891.391360] env[62909]: INFO networking_nsxv3.common.synchronization [req-23afa176-23f6-40ec-a3ca-95fcf944415d req-eb2d3eff-6b70-4f89-b2bb-8aeaa615c9b8 service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 891.391437] env[62909]: INFO networking_nsxv3.common.synchronization [req-23afa176-23f6-40ec-a3ca-95fcf944415d req-eb2d3eff-6b70-4f89-b2bb-8aeaa615c9b8 service nova] Enqueued Resource ID: 9be7ced3-94cd-47b2-8902-92429978705c with Priority: HIGHEST for action port [ 891.391909] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 891.392114] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 891.392913] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be7ced3-94cd-47b2-8902-92429978705c with Priority: HIGHEST for action port [ 891.392913] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.392913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.392913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.393247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.393247] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.394144] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.394244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.394497] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-9be7ced3-94cd-47b2-8902-92429978705c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.394593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9be7ced3-94cd-47b2-8902-92429978705c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.394660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9be7ced3-94cd-47b2-8902-92429978705c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.394826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9be7ced3-94cd-47b2-8902-92429978705c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.394898] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9be7ced3-94cd-47b2-8902-92429978705c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.686336] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: SUCCESS [ 891.686336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.686336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.686336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.686336] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.686891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.686891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.687153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.687272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.687408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.687528] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.756226] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e0b230b-d7d3-4c40-9cdd-92be876b4a05: rpc.has_security_group_logging(os_id): False [ 891.781304] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.781470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.781470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.781727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.782558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.782558] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.782558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.782558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.782558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.782774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.783013] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.783121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.783168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.783316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.783387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.783561] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.783648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.783894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.783894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.784385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.784385] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 891.846908] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.846908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.847098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.847282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.847359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.870773] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 891.896592] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.896689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.900123] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9be7ced3-94cd-47b2-8902-92429978705c with status ACTIVE [ 891.900327] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.900461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.900524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.900800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.900880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.901086] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.901192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.901246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.901397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.901471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.901837] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.901837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.901837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.902023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.902023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.902092] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9be7ced3-94cd-47b2-8902-92429978705c is going to be updated. [ 891.924688] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.924824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.924824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.925102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.925231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.925608] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9be7ced3-94cd-47b2-8902-92429978705c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.190423] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.201820] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 892.201992] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 892.202261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.202524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.202893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.202893] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.203082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.203082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.203232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.203311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.203450] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.693262] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7: rpc.has_security_group_logging(os_id): False [ 892.707407] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.711757] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.711953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.712075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.712350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.712484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.712768] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.712936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.713049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.713754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.713754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.713754] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 is going to be created. [ 892.775034] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.775034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.775034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.775263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.775387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.788850] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: IN_PROGRESS for 2s [ 893.210178] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.712786] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.713234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.713234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.713343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.717067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.717067] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 893.750274] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.750274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.750407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.750626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.750797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.764954] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 893.891112] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 893.891386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.188790] env[62909]: INFO networking_nsxv3.common.synchronization [req-da0ebc85-51ec-4975-b05c-b02390cb72da req-d7f83e90-25db-4517-adc1-afdbd4b355fc tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 894.189709] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 894.189709] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.189815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.189938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.191792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.191792] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.191792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.191792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.191792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.191792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.191792] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.534317] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-96 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.534511] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.534652] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.535017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.535622] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.535622] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.535622] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.535875] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.535927] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.536177] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.536276] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.536385] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.536510] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.536898] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.536898] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.537095] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.555937] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.556158] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.556287] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.556469] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.556782] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-5d5caccf-1912-40af-a849-900df4764c6f taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.556959] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-5d5caccf-1912-40af-a849-900df4764c6f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.557095] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-5d5caccf-1912-40af-a849-900df4764c6f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.557445] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-5d5caccf-1912-40af-a849-900df4764c6f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.557615] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d5caccf-1912-40af-a849-900df4764c6f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.694176] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.694410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.694410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.694986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.695149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.695376] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.695532] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.695595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.695801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.695882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.695935] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 already deleted. [ 894.695997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.801887] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: SUCCESS [ 894.802210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.912371] env[62909]: INFO networking_nsxv3.common.synchronization [req-49323baf-fd18-4912-95b1-27a07fada1ac req-d7ab0d56-23e1-4db0-8f0a-08ef2408c375 tempest-MigrationsAdminTest-16747298 tempest-MigrationsAdminTest-16747298-project-member] Enqueued Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 894.913262] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGHEST for action security_group_members [ 894.913445] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.913589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.913694] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.913956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.914727] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.914874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.914928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.915121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.915233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.915335] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.060411] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.060655] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.060861] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.061136] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.061265] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.061433] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 5d5caccf-1912-40af-a849-900df4764c6f not found, creating... [ 895.061750] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.061923] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.062053] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.062285] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.062428] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.062719] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.062924] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.063078] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.063299] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.063437] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.063583] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 5d5caccf-1912-40af-a849-900df4764c6f is going to be created. [ 895.087551] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.088038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.088257] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.088613] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.088895] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.089995] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-5d5caccf-1912-40af-a849-900df4764c6f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.422375] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.422569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.422609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.422814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.449368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.449619] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.449771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.449830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.450024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.450102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.450193] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b is going to be updated. [ 895.483482] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.483691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.483723] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.483947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.484115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.498620] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: IN_PROGRESS for 2s [ 895.776536] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 895.776798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.777012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.777357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.777572] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.777763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.777763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.777968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.778082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.778177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.778277] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.021197] env[62909]: INFO networking_nsxv3.common.synchronization [req-ee815cab-3528-4b38-8bde-dab0673e4663 req-d4d0f4d3-ee73-4a55-8e45-295359abc431 tempest-FloatingIPsAssociationTestJSON-150665211 tempest-FloatingIPsAssociationTestJSON-150665211-project-member] Enqueued Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 896.021779] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e with Priority: HIGHEST for action security_group_members [ 896.022425] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.022425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.022636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.022868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.023315] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.023457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.023554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.023809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.023942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.024121] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('009d27ce-c5b1-4df0-81b4-05b91e8ed19e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.056089] env[62909]: INFO networking_nsxv3.common.synchronization [req-da0ebc85-51ec-4975-b05c-b02390cb72da req-069161c8-b69d-4604-8dd0-43a12d4ba431 service nova] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_rules [ 896.056089] env[62909]: INFO networking_nsxv3.common.synchronization [req-da0ebc85-51ec-4975-b05c-b02390cb72da req-069161c8-b69d-4604-8dd0-43a12d4ba431 service nova] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 896.056089] env[62909]: INFO networking_nsxv3.common.synchronization [req-da0ebc85-51ec-4975-b05c-b02390cb72da req-069161c8-b69d-4604-8dd0-43a12d4ba431 service nova] Enqueued Resource ID: 5d5caccf-1912-40af-a849-900df4764c6f with Priority: HIGHEST for action port [ 896.056584] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_rules [ 896.056904] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 896.057182] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5caccf-1912-40af-a849-900df4764c6f with Priority: HIGHEST for action port [ 896.059164] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.059433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.061027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.061027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.061027] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.062038] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.062392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.062528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.062786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.063112] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.063315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.063454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.066020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.066020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.066020] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.066020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d5caccf-1912-40af-a849-900df4764c6f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.066020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d5caccf-1912-40af-a849-900df4764c6f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.066020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d5caccf-1912-40af-a849-900df4764c6f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.066020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d5caccf-1912-40af-a849-900df4764c6f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.066020] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d5caccf-1912-40af-a849-900df4764c6f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.281966] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.281966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.281966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.281966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.281966] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.281966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.281966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.281966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.281966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.281966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.282460] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.282460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.282460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.282460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.282460] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.282621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.282621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.282779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.282849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.282938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.283067] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.527307] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.527307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.527307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.527540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.556567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.556567] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.556567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.556806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.557427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.557427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.557427] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e is going to be updated. [ 896.570574] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.570753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.570999] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.572146] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d5caccf-1912-40af-a849-900df4764c6f with status ACTIVE [ 896.572397] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.572553] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.572699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.572908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.573050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.573276] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.574920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.574920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.574920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.574920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.577204] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.577773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.577962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.578405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.578620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.578815] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d5caccf-1912-40af-a849-900df4764c6f is going to be updated. [ 896.592368] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.592368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.592368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.592368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.592368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.602266] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: IN_PROGRESS for 2s [ 896.603582] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.603675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.603777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.604126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.604379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.604754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d5caccf-1912-40af-a849-900df4764c6f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.785311] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00039edf-d86f-462e-a706-bad2d411b887: rpc.has_security_group_logging(os_id): False [ 896.809195] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.809195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.809195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.809195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.809195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.809195] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.809195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.809195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.809195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.809515] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.809515] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.809580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.809721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.809768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.809902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.810057] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.810158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.810207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.810404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.810404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.810521] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 896.876449] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.876587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.876779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.876939] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.877137] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.892456] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 897.082747] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.508609] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b in Status: SUCCESS [ 897.508751] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b deletion is rescheduled due to dependency. [ 897.508867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.586712] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.587057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.587193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.587424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.587517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.587622] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be created. [ 897.611325] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.611591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.611591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.611714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.611886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.623713] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: UNINITIALIZED for 2s [ 898.614379] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e in Status: SUCCESS [ 898.614633] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009d27ce-c5b1-4df0-81b4-05b91e8ed19e deletion is rescheduled due to dependency. [ 898.614719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009d27ce-c5b1-4df0-81b4-05b91e8ed19e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.908112] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 898.908112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.635857] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 899.636391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.636391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.636632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.636632] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.636862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.636862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.637078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.637165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.637209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.637288] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.139905] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.645680] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ef8091d-5beb-460c-8d49-21cf9cd46551: rpc.has_security_group_logging(os_id): False [ 900.669270] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.669440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.669517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.669753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.669849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.670142] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.670259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.670312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.670463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.670538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.670676] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be created. [ 900.745663] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.745850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.745929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.746208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.746392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.761099] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 901.058525] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 901.058683] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 901.082778] env[62909]: INFO networking_nsxv3.common.synchronization [req-c28771bc-9cdd-4531-add3-36defb81a38e req-b2377564-d49c-4269-8199-ff0a50b18721 tempest-ImagesTestJSON-652168268 tempest-ImagesTestJSON-652168268-project-member] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 901.087023] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 901.087023] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.087023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.087023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.087023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.087023] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.087023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.087023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.087023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.087023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.087023] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.430429] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.430584] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.430705] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.430985] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.431562] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.431822] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.431999] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.432276] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.432429] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.432649] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.432766] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.432875] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.433048] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.433195] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.433309] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.433446] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.455114] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.455665] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 901.455665] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.455665] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.455914] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-ae4f4a6c-15e7-46f4-8edd-c415125f941c taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.456101] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-ae4f4a6c-15e7-46f4-8edd-c415125f941c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.456223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-ae4f4a6c-15e7-46f4-8edd-c415125f941c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.456566] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-ae4f4a6c-15e7-46f4-8edd-c415125f941c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.456701] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae4f4a6c-15e7-46f4-8edd-c415125f941c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.590196] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.959255] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.959573] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.959573] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.959816] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.959973] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.960145] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port ae4f4a6c-15e7-46f4-8edd-c415125f941c not found, creating... [ 901.960418] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.961016] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.961016] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.961016] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.964772] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.964772] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.965215] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.965215] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.965215] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.965425] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.965475] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: ae4f4a6c-15e7-46f4-8edd-c415125f941c is going to be created. [ 902.000796] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.001050] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.001188] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.001470] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.001783] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.002069] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-ae4f4a6c-15e7-46f4-8edd-c415125f941c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.093032] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.595697] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.595864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.595958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.596236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.596349] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.596433] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 902.628963] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.630284] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.630628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.630976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.631404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.644284] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 902.775033] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 902.775260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.149179] env[62909]: INFO networking_nsxv3.common.synchronization [req-c28771bc-9cdd-4531-add3-36defb81a38e req-99ff8824-5210-42c9-929d-5ab9a117d084 service nova] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_rules [ 903.150819] env[62909]: INFO networking_nsxv3.common.synchronization [req-c28771bc-9cdd-4531-add3-36defb81a38e req-99ff8824-5210-42c9-929d-5ab9a117d084 service nova] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 903.151360] env[62909]: INFO networking_nsxv3.common.synchronization [req-c28771bc-9cdd-4531-add3-36defb81a38e req-99ff8824-5210-42c9-929d-5ab9a117d084 service nova] Enqueued Resource ID: ae4f4a6c-15e7-46f4-8edd-c415125f941c with Priority: HIGHEST for action port [ 903.152250] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_rules [ 903.152568] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 903.152768] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4f4a6c-15e7-46f4-8edd-c415125f941c with Priority: HIGHEST for action port [ 903.153316] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.153560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.153794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.154092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.156151] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.156151] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.156151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.156151] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae4f4a6c-15e7-46f4-8edd-c415125f941c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.156539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae4f4a6c-15e7-46f4-8edd-c415125f941c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.156704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae4f4a6c-15e7-46f4-8edd-c415125f941c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.156964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae4f4a6c-15e7-46f4-8edd-c415125f941c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.157265] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae4f4a6c-15e7-46f4-8edd-c415125f941c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.659555] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.660332] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.667565] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae4f4a6c-15e7-46f4-8edd-c415125f941c with status ACTIVE [ 903.667565] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.667565] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.667565] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.667565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.668398] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae4f4a6c-15e7-46f4-8edd-c415125f941c is going to be updated. [ 903.692718] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.692881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.692947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.693206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.693344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.693514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae4f4a6c-15e7-46f4-8edd-c415125f941c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.655289] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 904.655633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.655789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.656015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.656230] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.656360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.656427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.656598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.656684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.656784] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.160136] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.662172] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.708757] env[62909]: INFO networking_nsxv3.common.synchronization [req-d7012f74-0446-470e-92cc-25ca3bee07c9 req-1689ec42-c345-4b3a-ae9e-64461483c5af tempest-ServersAdminTestJSON-1709758822 tempest-ServersAdminTestJSON-1709758822-project-member] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 905.709553] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 905.710115] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.710115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.710115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.710683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.710683] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.710683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.710683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.711118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.711118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.711215] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.164650] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.164814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.164885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.165131] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.165240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.165326] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 906.198563] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.198820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.198890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.199115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.199316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.211012] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 906.215019] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.296636] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-13 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.297297] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.297297] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.297456] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.297738] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.299105] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.299105] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.299105] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.299105] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.299105] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.299105] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.299105] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.299105] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.299105] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.299374] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.299374] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.320551] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.320851] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 906.321062] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.322045] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.322296] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-4ca49936-a41c-4418-a42a-114ca4faa7c4 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.322507] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-4ca49936-a41c-4418-a42a-114ca4faa7c4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.322670] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-4ca49936-a41c-4418-a42a-114ca4faa7c4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.324570] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-4ca49936-a41c-4418-a42a-114ca4faa7c4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.324570] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ca49936-a41c-4418-a42a-114ca4faa7c4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.716010] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.829019] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.829019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.829019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.829019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.829019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.829019] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 4ca49936-a41c-4418-a42a-114ca4faa7c4 not found, creating... [ 906.829019] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.829019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.829019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.829019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.829019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.829569] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.829569] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.830051] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.830429] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.830769] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.831085] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 4ca49936-a41c-4418-a42a-114ca4faa7c4 is going to be created. [ 906.857219] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.857219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.857219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.857219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.857219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.857219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-4ca49936-a41c-4418-a42a-114ca4faa7c4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.218736] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.219061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.219163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.219398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.219492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.219707] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 907.252939] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.252939] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.253123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.253239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.253363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.261867] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 907.883337] env[62909]: INFO networking_nsxv3.common.synchronization [req-d7012f74-0446-470e-92cc-25ca3bee07c9 req-feda25b1-acbc-4b2a-a495-7fb9e9cbf461 service nova] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_rules [ 907.883608] env[62909]: INFO networking_nsxv3.common.synchronization [req-d7012f74-0446-470e-92cc-25ca3bee07c9 req-feda25b1-acbc-4b2a-a495-7fb9e9cbf461 service nova] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 907.883710] env[62909]: INFO networking_nsxv3.common.synchronization [req-d7012f74-0446-470e-92cc-25ca3bee07c9 req-feda25b1-acbc-4b2a-a495-7fb9e9cbf461 service nova] Enqueued Resource ID: 4ca49936-a41c-4418-a42a-114ca4faa7c4 with Priority: HIGHEST for action port [ 907.884159] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_rules [ 907.884296] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 907.884392] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca49936-a41c-4418-a42a-114ca4faa7c4 with Priority: HIGHEST for action port [ 907.884659] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.885112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.885112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.885257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.885305] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.886551] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.886649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.886835] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ca49936-a41c-4418-a42a-114ca4faa7c4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.886935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ca49936-a41c-4418-a42a-114ca4faa7c4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.886998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ca49936-a41c-4418-a42a-114ca4faa7c4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.887309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ca49936-a41c-4418-a42a-114ca4faa7c4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.887309] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ca49936-a41c-4418-a42a-114ca4faa7c4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.223021] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 4s [ 908.389880] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.389880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.395148] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ca49936-a41c-4418-a42a-114ca4faa7c4 with status ACTIVE [ 908.395148] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.395148] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.395148] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.395148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.395148] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ca49936-a41c-4418-a42a-114ca4faa7c4 is going to be updated. [ 908.419035] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.419192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.419267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.419490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.419632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.420821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ca49936-a41c-4418-a42a-114ca4faa7c4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.272450] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 909.272926] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.273182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.273403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.273593] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.273771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.273890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.274143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.274257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.274363] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.777072] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.781074] env[62909]: INFO networking_nsxv3.common.synchronization [req-d7c3a8dd-3512-4903-8c52-6b4e2b0d1e64 req-b0234c9f-7f76-42b5-a2c1-9945f69076c6 tempest-ListServerFiltersTestJSON-403224292 tempest-ListServerFiltersTestJSON-403224292-project-member] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 909.781074] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGHEST for action security_group_members [ 909.781365] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.781491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.781621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.781771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.781928] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.782469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.782469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.782469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.782469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.783194] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.232837] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 910.233360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.233536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.233777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.233979] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.234257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.234257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.234624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.234768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.234869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.234965] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.281819] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.286567] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.286567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.286567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.286567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.326021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.326321] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.326435] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.326503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.326716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.326803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.326897] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be updated. [ 910.374745] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.374745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.374745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.375266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.375266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.386283] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: IN_PROGRESS for 2s [ 910.737845] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.738086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.738221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.738500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.742426] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.742426] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.742426] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.742426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.742426] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.785424] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.785978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.786170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.786385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.786488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.786843] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 910.819771] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.819934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.819994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.820214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.820334] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.832451] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 911.244856] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 828a3fee-5001-4141-bcfb-64c185ab0efa: rpc.has_security_group_logging(os_id): False [ 911.267803] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.268072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.268186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.268508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.310250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.310609] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.310764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.310827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.311040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.311130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.311423] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.311583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.311680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.311921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.312055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.312365] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.312534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.312634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.312863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.315428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.315428] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 911.383678] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.383890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.383890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.384121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.384258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.400567] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 912.398962] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf1c820f-c032-491e-a171-042f82234545 in Status: SUCCESS [ 912.399359] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf1c820f-c032-491e-a171-042f82234545 deletion is rescheduled due to dependency. [ 912.399359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.845396] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 912.845705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.845917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.846173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.846371] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.846493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.846551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.846710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.846789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.846873] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.846968] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.349484] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.349484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.349484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.349802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.349920] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.350011] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.350061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.350213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.350304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.350394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.350542] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.350633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.350713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.351168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.351168] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.351168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.351168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.351360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.351360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.351456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.351542] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.533599] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 913.534053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.858022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5: rpc.has_security_group_logging(os_id): False [ 913.877032] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.877032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.877032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.877535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.897668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.898662] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.898662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.898662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.898662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.898662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.898662] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.898962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.898962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.899031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.899076] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.899255] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.899342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.899398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.899529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.899596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.899676] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 913.967923] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.968102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.968160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.968384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.968549] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.984514] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 914.781867] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 914.782253] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 916.005902] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 916.005902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.807700] env[62909]: INFO networking_nsxv3.common.synchronization [req-c457e963-77f1-4676-9918-0ba575e44d47 req-ee247924-df1b-4bab-8712-9eb47d876f02 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 917.808398] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 917.808869] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.809017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.809094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.809353] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.809515] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.809613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.809674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.809825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.809946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.810781] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.142393] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.142645] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.142786] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.144103] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.144103] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.144103] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.144103] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.144103] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.144103] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.145244] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.145244] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.145244] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.145244] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.145595] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.145595] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.145783] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.168377] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.168632] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 918.168835] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.169094] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.169491] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-24c487f8-b730-47b7-8817-5b3894271b0f taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.169739] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-24c487f8-b730-47b7-8817-5b3894271b0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.170037] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-24c487f8-b730-47b7-8817-5b3894271b0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.170399] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-24c487f8-b730-47b7-8817-5b3894271b0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.170598] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24c487f8-b730-47b7-8817-5b3894271b0f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.314331] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.314331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.314331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.314331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.314331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.314331] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.314331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.314331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.314331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.314331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.314331] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 already deleted. [ 918.314331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.673333] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.673656] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.673758] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.674074] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.674251] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.674606] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 24c487f8-b730-47b7-8817-5b3894271b0f not found, creating... [ 918.674717] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.675175] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.675175] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.675299] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.675439] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.676057] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.676057] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.676057] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.676297] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.676445] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.676527] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 24c487f8-b730-47b7-8817-5b3894271b0f is going to be created. [ 918.700649] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.701120] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.701120] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.701405] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.701631] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.701923] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-24c487f8-b730-47b7-8817-5b3894271b0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.444393] env[62909]: INFO networking_nsxv3.common.synchronization [req-c457e963-77f1-4676-9918-0ba575e44d47 req-df380502-5f37-4e5f-87cb-9a0fc19aa460 service nova] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_rules [ 919.444656] env[62909]: INFO networking_nsxv3.common.synchronization [req-c457e963-77f1-4676-9918-0ba575e44d47 req-df380502-5f37-4e5f-87cb-9a0fc19aa460 service nova] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 919.444742] env[62909]: INFO networking_nsxv3.common.synchronization [req-c457e963-77f1-4676-9918-0ba575e44d47 req-df380502-5f37-4e5f-87cb-9a0fc19aa460 service nova] Enqueued Resource ID: 24c487f8-b730-47b7-8817-5b3894271b0f with Priority: HIGHEST for action port [ 919.444938] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_rules [ 919.445073] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 919.445172] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c487f8-b730-47b7-8817-5b3894271b0f with Priority: HIGHEST for action port [ 919.446199] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.446337] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.446418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.446593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.446673] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.447542] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.447638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.447671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.448249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.448249] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.448249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.448249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.448249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.448490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.448490] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.449125] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-24c487f8-b730-47b7-8817-5b3894271b0f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.449225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24c487f8-b730-47b7-8817-5b3894271b0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.449289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24c487f8-b730-47b7-8817-5b3894271b0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.449433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24c487f8-b730-47b7-8817-5b3894271b0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.449506] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24c487f8-b730-47b7-8817-5b3894271b0f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.951077] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.951417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.951865] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.952404] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24c487f8-b730-47b7-8817-5b3894271b0f with status ACTIVE [ 919.952592] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.952805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.952805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.953074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.953180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.953279] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.953367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.953421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.953580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.953725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.953855] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.954054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.954054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.954425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.954425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.954526] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24c487f8-b730-47b7-8817-5b3894271b0f is going to be updated. [ 919.978255] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.978439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.978439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.981143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.981143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.981143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24c487f8-b730-47b7-8817-5b3894271b0f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.456882] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.484059] env[62909]: INFO networking_nsxv3.common.synchronization [req-0807f5ee-af07-461c-89f3-94984780e4be req-562447ac-c1dd-4717-979c-f25037f43467 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_members [ 920.484059] env[62909]: INFO networking_nsxv3.common.synchronization [req-0807f5ee-af07-461c-89f3-94984780e4be req-562447ac-c1dd-4717-979c-f25037f43467 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGHEST for action security_group_members [ 920.484059] env[62909]: INFO networking_nsxv3.common.synchronization [req-0807f5ee-af07-461c-89f3-94984780e4be req-562447ac-c1dd-4717-979c-f25037f43467 tempest-SecurityGroupsTestJSON-92077384 tempest-SecurityGroupsTestJSON-92077384-project-member] Enqueued Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 920.485115] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGHEST for action security_group_members [ 920.485115] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGHEST for action security_group_members [ 920.485115] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 with Priority: HIGHEST for action security_group_members [ 920.485353] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-3015041e-e0eb-4083-abbf-3bfc49610323 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.485508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.485568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.485736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.485897] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.486924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.486924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.486924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.486924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.486924] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.487234] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e414027f-367d-4f4e-abad-e74bd2a6a762 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.487348] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.487413] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.491788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.491788] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.491788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.491788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.491788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.492418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.492418] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.494371] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.494371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.494371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.498186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.498186] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.498186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.498186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.498186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.498186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.498186] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e0b230b-d7d3-4c40-9cdd-92be876b4a05',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.854459] env[62909]: INFO networking_nsxv3.common.synchronization [req-632b3ef9-2be8-4c4a-8d27-3cf992827c9f req-f791f725-10db-46b3-ac98-433056ce43de tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 920.855029] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 920.856086] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.856086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.856086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.856086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.856086] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.856086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.859208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.859436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.859531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.859633] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.959772] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.960087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.960227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.961222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.961493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.961656] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 is going to be created. [ 920.994812] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.995258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.995485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.995662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.995880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.997162] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.997314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.997432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.997644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.999046] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.999046] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.999959] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.000115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.011424] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: UNINITIALIZED for 2s [ 921.029627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.029934] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.030075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.030171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.032394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.032514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.032641] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3015041e-e0eb-4083-abbf-3bfc49610323 is going to be updated. [ 921.033721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.033932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.068155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.068487] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.068607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.068698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.068910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.068991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.069101] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e414027f-367d-4f4e-abad-e74bd2a6a762 is going to be updated. [ 921.070073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.070252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.070427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.070510] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.070614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.070668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.070889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.070960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.071058] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 is going to be updated. [ 921.079427] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.079596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.079670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.079927] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.080118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.092874] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: IN_PROGRESS for 2s [ 921.111876] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.112109] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.112186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.112412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.112558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.121720] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.121888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.121888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.122121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.122259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.124240] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e414027f-367d-4f4e-abad-e74bd2a6a762 in Status: IN_PROGRESS for 2s [ 921.132025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: IN_PROGRESS for 2s [ 921.363838] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.364110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.364110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.364305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.364387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.364584] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.364674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.364736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.364878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.364954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.365052] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 921.406655] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.406809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.406862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.407141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.407674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.418058] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 923.029240] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: SUCCESS [ 923.029240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.029240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.029240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.029240] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.029240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.029240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.029240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.029240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.029240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.029240] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.107387] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3015041e-e0eb-4083-abbf-3bfc49610323 in Status: SUCCESS [ 923.107572] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3015041e-e0eb-4083-abbf-3bfc49610323 deletion is rescheduled due to dependency. [ 923.107681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.136478] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e414027f-367d-4f4e-abad-e74bd2a6a762 in Status: SUCCESS [ 923.137135] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e414027f-367d-4f4e-abad-e74bd2a6a762 deletion is rescheduled due to dependency. [ 923.137317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.139800] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 in Status: SUCCESS [ 923.140157] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e0b230b-d7d3-4c40-9cdd-92be876b4a05 deletion is rescheduled due to dependency. [ 923.140244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e0b230b-d7d3-4c40-9cdd-92be876b4a05" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.429515] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 923.429691] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 923.429816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.448951] env[62909]: INFO networking_nsxv3.common.synchronization [req-63b61dbf-2437-45ab-a9d2-d21e4f5ae607 req-4cd11af5-a9be-4e85-8997-9f5db90be96a tempest-ImagesTestJSON-652168268 tempest-ImagesTestJSON-652168268-project-member] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 923.449458] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 923.449758] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.449873] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.449932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.454237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.454427] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.454538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.454601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.454766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.454853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.454951] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.544980] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.960296] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.047502] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7b8e547-f24c-4b71-8565-214f37cb5c01: rpc.has_security_group_logging(os_id): False [ 924.065562] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.065722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.065786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.065996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.066134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.066341] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.066450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.066497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.066643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.066715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.066798] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 is going to be created. [ 924.137261] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.137261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.137261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.137261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.137261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.148032] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: IN_PROGRESS for 2s [ 924.461897] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.965152] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.965326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.965326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.965810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.965810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.965959] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 925.002259] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.002259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.002259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.002534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.002930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.018887] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 925.336743] env[62909]: INFO networking_nsxv3.common.synchronization [req-2c6be884-d7f6-42a2-94db-11482692f6a0 req-c4719ea1-1e71-4b36-becf-94b9430972af tempest-ServerActionsTestOtherB-1631848678 tempest-ServerActionsTestOtherB-1631848678-project-member] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 925.336743] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 925.336743] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.336743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.336743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.336743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.336743] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.336743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.337255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.337255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.337255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.337255] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.841715] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.841715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.841715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.841715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.865498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.865743] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.865868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.865954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.866214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.866302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.866411] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 925.894103] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.894311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.894380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.894578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.894715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.904712] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 925.934646] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.934937] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.935115] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.935547] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.936135] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.936135] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.936135] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.936747] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.936747] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.936747] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.936912] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.937067] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.937191] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.937328] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.937442] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.937580] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.958161] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.958422] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 925.958479] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.958698] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.959071] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-94d0e4cd-493e-4e41-89dc-b0636889e9d9 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.959256] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-94d0e4cd-493e-4e41-89dc-b0636889e9d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.959400] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-94d0e4cd-493e-4e41-89dc-b0636889e9d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.959756] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-94d0e4cd-493e-4e41-89dc-b0636889e9d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.960277] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94d0e4cd-493e-4e41-89dc-b0636889e9d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.172725] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: SUCCESS [ 926.173083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.466049] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.466049] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.466049] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.466049] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.466049] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.466049] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 94d0e4cd-493e-4e41-89dc-b0636889e9d9 not found, creating... [ 926.466049] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.466049] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.466553] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.466553] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.466553] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.466805] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.467050] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.467108] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.467293] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.467427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.467570] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 94d0e4cd-493e-4e41-89dc-b0636889e9d9 is going to be created. [ 926.504025] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.504025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.504025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.504025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.504025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.504025] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-94d0e4cd-493e-4e41-89dc-b0636889e9d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.031539] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 927.031952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.427969] env[62909]: INFO networking_nsxv3.common.synchronization [req-2c6be884-d7f6-42a2-94db-11482692f6a0 req-35d219ad-9085-426e-9952-5ea5af79e613 service nova] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 927.428262] env[62909]: INFO networking_nsxv3.common.synchronization [req-2c6be884-d7f6-42a2-94db-11482692f6a0 req-35d219ad-9085-426e-9952-5ea5af79e613 service nova] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 927.428407] env[62909]: INFO networking_nsxv3.common.synchronization [req-2c6be884-d7f6-42a2-94db-11482692f6a0 req-35d219ad-9085-426e-9952-5ea5af79e613 service nova] Enqueued Resource ID: 94d0e4cd-493e-4e41-89dc-b0636889e9d9 with Priority: HIGHEST for action port [ 927.428992] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 927.429161] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 927.429395] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d0e4cd-493e-4e41-89dc-b0636889e9d9 with Priority: HIGHEST for action port [ 927.431019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.431019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.431019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.431019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.431019] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.431019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.431019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.431314] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-94d0e4cd-493e-4e41-89dc-b0636889e9d9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.431383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94d0e4cd-493e-4e41-89dc-b0636889e9d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.431496] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94d0e4cd-493e-4e41-89dc-b0636889e9d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.431692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94d0e4cd-493e-4e41-89dc-b0636889e9d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.431789] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94d0e4cd-493e-4e41-89dc-b0636889e9d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.916695] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 927.917062] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a deletion is rescheduled due to dependency. [ 927.917062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.917062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.918232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.918232] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.918232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.918232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.918232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.918232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.918232] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.933413] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.933548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.934037] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94d0e4cd-493e-4e41-89dc-b0636889e9d9 with status ACTIVE [ 927.934716] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.934716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.934716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.934716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.934716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.935043] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.935043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.935043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.935217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.935264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.935440] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.935942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.935942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.935942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.935942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.935942] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94d0e4cd-493e-4e41-89dc-b0636889e9d9 is going to be updated. [ 927.960520] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.960520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.960520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.960520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.960520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.960520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94d0e4cd-493e-4e41-89dc-b0636889e9d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.420862] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.926086] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.116188] env[62909]: INFO networking_nsxv3.common.synchronization [req-39f5de54-b5e5-4e60-97f9-38f65a523f2c req-740779d1-d048-4bd9-9e44-39ecda82e3b0 tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 929.116188] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 929.116367] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.116485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.116579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.116737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.116879] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.116977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.117454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.117649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.117755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.117860] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.141367] env[62909]: INFO networking_nsxv3.common.synchronization [req-39f5de54-b5e5-4e60-97f9-38f65a523f2c req-740779d1-d048-4bd9-9e44-39ecda82e3b0 tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_rules [ 929.141367] env[62909]: INFO networking_nsxv3.common.synchronization [req-39f5de54-b5e5-4e60-97f9-38f65a523f2c req-740779d1-d048-4bd9-9e44-39ecda82e3b0 tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 929.141367] env[62909]: INFO networking_nsxv3.common.synchronization [req-39f5de54-b5e5-4e60-97f9-38f65a523f2c req-740779d1-d048-4bd9-9e44-39ecda82e3b0 tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: 3dc57e52-6e86-4d59-bf3e-c46b60446825 with Priority: HIGHEST for action port [ 929.141896] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_rules [ 929.141976] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 929.142536] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc57e52-6e86-4d59-bf3e-c46b60446825 with Priority: HIGHEST for action port [ 929.142675] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.142752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.142870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.143530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.143640] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.144636] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.144737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.144931] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dc57e52-6e86-4d59-bf3e-c46b60446825 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.145089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.145132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.145314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.145370] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc57e52-6e86-4d59-bf3e-c46b60446825',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.428223] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.428394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.428467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.428783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.428911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.429094] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 929.460970] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.461551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.461764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.462100] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.463082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.472464] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 929.620608] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.652577] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dc57e52-6e86-4d59-bf3e-c46b60446825 with status ACTIVE [ 929.652577] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.652840] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.652840] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.653276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.653427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.653739] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.653903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.654020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.654264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.654382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.654615] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.654778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.654824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.654977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.655105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.655147] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dc57e52-6e86-4d59-bf3e-c46b60446825 is going to be updated. [ 929.656809] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.656809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.680754] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.680754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.680754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.680754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.680954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.681082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.125760] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.133320] env[62909]: INFO networking_nsxv3.common.synchronization [req-0658954a-c377-4871-96d1-403dc354c638 req-d86eab67-bda9-4689-a476-988f969e906b tempest-ServersNegativeTestJSON-170677023 tempest-ServersNegativeTestJSON-170677023-project-member] Enqueued Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 930.133320] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 930.133320] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.134163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.134163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.134418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.134539] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.134660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.134724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.134883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.135089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.135089] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.632955] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.633363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.633459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.634201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.634201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.634201] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05b8610-e099-492a-a795-e90ed01da010 is going to be updated. [ 930.636927] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.669705] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.669922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.670014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.670181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.670503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.682387] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: IN_PROGRESS for 2s [ 930.724940] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-65 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.726232] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.726232] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.726232] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.726232] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.726565] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.726807] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.727366] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.727366] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.728770] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.728950] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.729109] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.729242] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.729437] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.729505] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.729670] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.753161] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.754271] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 930.754271] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.754271] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.754271] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-8074d5d3-e32f-45b2-94c7-d1c4105fb78d taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.754916] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-8074d5d3-e32f-45b2-94c7-d1c4105fb78d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.754916] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-8074d5d3-e32f-45b2-94c7-d1c4105fb78d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.754916] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-8074d5d3-e32f-45b2-94c7-d1c4105fb78d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.757346] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8074d5d3-e32f-45b2-94c7-d1c4105fb78d',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.140049] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.257284] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.257521] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.258935] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.259306] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.259480] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.259630] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 8074d5d3-e32f-45b2-94c7-d1c4105fb78d not found, creating... [ 931.259945] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.260140] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.260265] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.260511] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.260655] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.261078] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.261163] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.261286] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.261502] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.261636] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.261779] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 8074d5d3-e32f-45b2-94c7-d1c4105fb78d is going to be created. [ 931.297317] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.297547] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.297676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.297979] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.298242] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.298476] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-8074d5d3-e32f-45b2-94c7-d1c4105fb78d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.484258] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 931.484476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.484645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.484895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.485093] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.485206] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.485270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.485428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.485505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.485592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.485680] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.642358] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.642358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.642745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.642782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.642877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.643032] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd is going to be updated. [ 931.679459] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.679626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.679703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.679913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.680069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.692351] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: IN_PROGRESS for 2s [ 931.988541] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.336679] env[62909]: INFO networking_nsxv3.common.synchronization [req-0658954a-c377-4871-96d1-403dc354c638 req-c63ed8cb-4e35-49fc-abd4-d9423f24efd4 service nova] Enqueued Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_rules [ 932.336924] env[62909]: INFO networking_nsxv3.common.synchronization [req-0658954a-c377-4871-96d1-403dc354c638 req-c63ed8cb-4e35-49fc-abd4-d9423f24efd4 service nova] Enqueued Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 932.337016] env[62909]: INFO networking_nsxv3.common.synchronization [req-0658954a-c377-4871-96d1-403dc354c638 req-c63ed8cb-4e35-49fc-abd4-d9423f24efd4 service nova] Enqueued Resource ID: 8074d5d3-e32f-45b2-94c7-d1c4105fb78d with Priority: HIGHEST for action port [ 932.337262] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_rules [ 932.337389] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 932.337480] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8074d5d3-e32f-45b2-94c7-d1c4105fb78d with Priority: HIGHEST for action port [ 932.338049] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.338179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.338243] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.338437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.338516] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.339511] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.339511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.339840] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-8074d5d3-e32f-45b2-94c7-d1c4105fb78d taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.339840] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8074d5d3-e32f-45b2-94c7-d1c4105fb78d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.339840] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8074d5d3-e32f-45b2-94c7-d1c4105fb78d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.340303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8074d5d3-e32f-45b2-94c7-d1c4105fb78d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.340303] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8074d5d3-e32f-45b2-94c7-d1c4105fb78d',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.490877] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23297eee-5815-4160-b6ed-90818fa0ab3a: rpc.has_security_group_logging(os_id): False [ 932.510525] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.510776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.510918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.511167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.511265] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.511538] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.511635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.511701] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.511933] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.512032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.512096] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 932.519850] env[62909]: INFO networking_nsxv3.common.synchronization [req-a034b73e-1c65-42e1-9f07-eb8f6cda5e07 req-b61e18df-134e-4bdf-9e6f-e72f78b93e9c tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 932.520457] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 932.520901] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.521016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.530787] env[62909]: INFO networking_nsxv3.common.synchronization [req-a034b73e-1c65-42e1-9f07-eb8f6cda5e07 req-b61e18df-134e-4bdf-9e6f-e72f78b93e9c tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_rules [ 932.531028] env[62909]: INFO networking_nsxv3.common.synchronization [req-a034b73e-1c65-42e1-9f07-eb8f6cda5e07 req-b61e18df-134e-4bdf-9e6f-e72f78b93e9c tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 932.531183] env[62909]: INFO networking_nsxv3.common.synchronization [req-a034b73e-1c65-42e1-9f07-eb8f6cda5e07 req-b61e18df-134e-4bdf-9e6f-e72f78b93e9c tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: 3dc57e52-6e86-4d59-bf3e-c46b60446825 with Priority: HIGHEST for action port [ 932.532461] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_rules [ 932.532461] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 932.532461] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc57e52-6e86-4d59-bf3e-c46b60446825 with Priority: HIGHEST for action port [ 932.532461] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.532798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.532798] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.532798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.532931] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dc57e52-6e86-4d59-bf3e-c46b60446825 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.534181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.534302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.534591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.534591] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc57e52-6e86-4d59-bf3e-c46b60446825',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.580571] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.580721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.580790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.581054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.581212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.594218] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 932.704297] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: SUCCESS [ 932.704572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.704697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.704962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.705274] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.705347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.705425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.705619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.705689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.705793] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.844410] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.844410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.844410] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8074d5d3-e32f-45b2-94c7-d1c4105fb78d with status ACTIVE [ 932.844410] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.844410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.844410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.844410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.844410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.844410] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.844410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.844410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.844410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.844410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.844410] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.845237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.845237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.845237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.845237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.845237] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8074d5d3-e32f-45b2-94c7-d1c4105fb78d is going to be updated. [ 932.871222] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.871395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.871455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.871630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.871777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.871924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8074d5d3-e32f-45b2-94c7-d1c4105fb78d" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.037309] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dc57e52-6e86-4d59-bf3e-c46b60446825 with status ACTIVE [ 933.037676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.037898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.038034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.038357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.038502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.038772] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.038895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.038961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.039149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.039230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.039451] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.039527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.039609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.039757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.039834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.039964] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dc57e52-6e86-4d59-bf3e-c46b60446825 is going to be updated. [ 933.074412] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.074412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.074412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.074412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.074412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.074412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dc57e52-6e86-4d59-bf3e-c46b60446825" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.210416] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.703618] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: SUCCESS [ 933.703927] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.704193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.704477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.704742] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.704891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.704963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.705162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.705244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.705339] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.712110] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.209195] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.215520] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.215684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.215834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.215989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.216088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.216187] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05b8610-e099-492a-a795-e90ed01da010 is going to be updated. [ 934.255607] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.255607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.255607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.255607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.255607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.266416] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: IN_PROGRESS for 2s [ 934.611738] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 934.612064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.713103] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.973093] env[62909]: INFO networking_nsxv3.common.synchronization [req-7081fb30-9229-4cbe-84ff-3b560deccf53 req-f32cc4d1-3797-4bc1-a66a-bbb5b56cf6ee tempest-MultipleCreateTestJSON-1768884473 tempest-MultipleCreateTestJSON-1768884473-project-member] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 934.973093] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 934.973440] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.973510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.973597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.973816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.973973] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.975851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.975851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.975997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.976130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.976258] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.216177] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.216367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.216466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.216833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.216833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.217085] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd is going to be updated. [ 935.257187] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.257400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.257535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.257823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.258039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.269661] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: IN_PROGRESS for 2s [ 935.340105] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-218 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.340316] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.340448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.340749] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.341142] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.341313] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.341434] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.341663] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.341899] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.342205] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.342331] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.342452] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.342566] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.342680] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.342788] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.342926] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.368615] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.368834] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 935.368986] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.369500] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.369575] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-576d897f-ee4d-4cda-bd9b-c835b51d2113 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.370709] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-576d897f-ee4d-4cda-bd9b-c835b51d2113" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.370709] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-576d897f-ee4d-4cda-bd9b-c835b51d2113" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.371301] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-576d897f-ee4d-4cda-bd9b-c835b51d2113" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.371467] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('576d897f-ee4d-4cda-bd9b-c835b51d2113',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.483123] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.483123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.483123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.483123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.502839] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.503358] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.503358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.503358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.503777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.503777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.503777] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 935.530615] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.530788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.531920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.531920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.531920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.543858] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 935.875550] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.875921] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.875984] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.876241] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.876406] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.876564] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 576d897f-ee4d-4cda-bd9b-c835b51d2113 not found, creating... [ 935.876827] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.877030] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.877195] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.877421] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.877561] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.877854] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.878146] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.878293] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.878560] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.878630] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.878776] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 576d897f-ee4d-4cda-bd9b-c835b51d2113 is going to be created. [ 935.902676] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.902676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.902676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.902676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.902676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.902676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-576d897f-ee4d-4cda-bd9b-c835b51d2113" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.287319] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: SUCCESS [ 936.287319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.287319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.287319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.287319] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.287319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.287319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.287319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.287319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.287319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.287319] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.289543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.289857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.290140] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.290713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.290972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.291253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.291433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.291619] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.476185] env[62909]: INFO networking_nsxv3.common.synchronization [req-cf1e9c81-a644-425c-ab4e-89b44ab82c19 req-87977046-43da-4304-9e3a-9aa3bfca4a1c tempest-AttachInterfacesUnderV243Test-1577368867 tempest-AttachInterfacesUnderV243Test-1577368867-project-member] Enqueued Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 936.476185] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05b8610-e099-492a-a795-e90ed01da010 with Priority: HIGHEST for action security_group_members [ 936.476185] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-a05b8610-e099-492a-a795-e90ed01da010 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.476185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.791505] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.793769] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.904000] env[62909]: INFO networking_nsxv3.common.synchronization [req-7081fb30-9229-4cbe-84ff-3b560deccf53 req-54b94437-c0ff-4ad3-a20b-09cb485a9faa service nova] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_rules [ 936.904000] env[62909]: INFO networking_nsxv3.common.synchronization [req-7081fb30-9229-4cbe-84ff-3b560deccf53 req-54b94437-c0ff-4ad3-a20b-09cb485a9faa service nova] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 936.904000] env[62909]: INFO networking_nsxv3.common.synchronization [req-7081fb30-9229-4cbe-84ff-3b560deccf53 req-54b94437-c0ff-4ad3-a20b-09cb485a9faa service nova] Enqueued Resource ID: 576d897f-ee4d-4cda-bd9b-c835b51d2113 with Priority: HIGHEST for action port [ 936.904000] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_rules [ 936.904000] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 936.904000] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576d897f-ee4d-4cda-bd9b-c835b51d2113 with Priority: HIGHEST for action port [ 936.904000] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.904000] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.904000] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.904000] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.908146] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.909085] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.909192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.909406] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-576d897f-ee4d-4cda-bd9b-c835b51d2113 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.909507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-576d897f-ee4d-4cda-bd9b-c835b51d2113" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.909563] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-576d897f-ee4d-4cda-bd9b-c835b51d2113" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.909757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-576d897f-ee4d-4cda-bd9b-c835b51d2113" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.909832] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('576d897f-ee4d-4cda-bd9b-c835b51d2113',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.283581] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: SUCCESS [ 937.283798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.283969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.284202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.284695] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.284695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.284695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.284872] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.284872] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.284939] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.284971] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.293713] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a05b8610-e099-492a-a795-e90ed01da010: rpc.has_security_group_logging(os_id): False [ 937.296470] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.340355] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.340355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.340355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.340355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.375299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.375299] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.375299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.376050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.376450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.376764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.378510] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a05b8610-e099-492a-a795-e90ed01da010 is going to be updated. [ 937.412141] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.412141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.419246] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 576d897f-ee4d-4cda-bd9b-c835b51d2113 with status ACTIVE [ 937.419246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.419246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.419246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.419246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.419246] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 576d897f-ee4d-4cda-bd9b-c835b51d2113 is going to be updated. [ 937.449097] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.449097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.449097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.449097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.449097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.449097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-576d897f-ee4d-4cda-bd9b-c835b51d2113" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.453989] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.453989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.453989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.453989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.453989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.473455] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: IN_PROGRESS for 2s [ 937.579670] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 937.580134] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 deletion is rescheduled due to dependency. [ 937.580660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.581035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.581429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.581747] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.582887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.584028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.584028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.584028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.584028] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.792532] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.792770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.792848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.793187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.793448] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.793448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.793553] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.793666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.793779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.793876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.794848] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.794848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.794848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.794848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.794848] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.794848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.794848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.794848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.794848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.795418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.797532] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.798696] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.799022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.799074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.799239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.799339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.801159] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05b8610-e099-492a-a795-e90ed01da010 is going to be updated. [ 937.837400] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.838908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.839092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.839389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.839670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.850054] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: IN_PROGRESS for 2s [ 938.087809] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.265629] env[62909]: INFO networking_nsxv3.common.synchronization [req-7081fb30-9229-4cbe-84ff-3b560deccf53 req-003b2395-4674-4985-8353-b9fb045d0757 tempest-MultipleCreateTestJSON-1768884473 tempest-MultipleCreateTestJSON-1768884473-project-member] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 938.266211] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 938.266529] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.266635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.308024] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f28a45c0-8394-4cec-b3b7-949be46fb2dd: rpc.has_security_group_logging(os_id): False [ 938.336042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.336042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.336042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.336042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.336387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.336925] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.336925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.336925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.337151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.337151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.337314] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.337407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.337935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.337935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.337935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.339481] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.339658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.339752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.339952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.340077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.340196] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd is going to be updated. [ 938.428562] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.428562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.428562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.428562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.428562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.444528] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: IN_PROGRESS for 2s [ 938.591665] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.772204] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-218 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.772482] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.772830] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.773304] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.773728] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.773986] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.774173] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.774506] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.774831] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.775330] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.775616] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.775891] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.776071] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.776290] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.776498] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.776727] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.804340] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.804340] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.804340] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.804340] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-218" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.804340] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-27d5fb42-82df-4642-9ddc-5a34ed445dfc taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.804340] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-27d5fb42-82df-4642-9ddc-5a34ed445dfc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.804340] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-27d5fb42-82df-4642-9ddc-5a34ed445dfc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.804340] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-27d5fb42-82df-4642-9ddc-5a34ed445dfc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.804340] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27d5fb42-82df-4642-9ddc-5a34ed445dfc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.095451] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.095878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.095878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.099026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.099026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.099026] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 939.130357] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.130573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.130744] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.131049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.131218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.142177] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 939.305443] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.306327] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.306327] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.306466] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.306601] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.306833] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 27d5fb42-82df-4642-9ddc-5a34ed445dfc not found, creating... [ 939.307216] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.307393] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.307651] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.307957] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.312383] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.312877] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.313102] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.313238] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.313543] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.313726] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.313911] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 27d5fb42-82df-4642-9ddc-5a34ed445dfc is going to be created. [ 939.346750] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.348038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.348038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.348038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.348038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.348038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-27d5fb42-82df-4642-9ddc-5a34ed445dfc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.513466] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: SUCCESS [ 939.513466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.513466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.513466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.513466] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.860303] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a05b8610-e099-492a-a795-e90ed01da010 in Status: SUCCESS [ 939.860652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.860966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.861274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.861625] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.861625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.861928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.861928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.861928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.862205] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.042503] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.042503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.042503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.042503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.042503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.042503] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a05b8610-e099-492a-a795-e90ed01da010 is going to be deleted. [ 940.075343] env[62909]: INFO networking_nsxv3.common.synchronization [None req-bc5d9420-9f8f-49a2-b2de-7915e455026a None None] Enqueued Resource ID: 5bc1e213-f023-49d3-885f-413472a17ba2 with Priority: HIGHEST for action port [ 940.075343] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bc1e213-f023-49d3-885f-413472a17ba2 with Priority: HIGHEST for action port [ 940.076470] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bc1e213-f023-49d3-885f-413472a17ba2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.078452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bc1e213-f023-49d3-885f-413472a17ba2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.078452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bc1e213-f023-49d3-885f-413472a17ba2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.078452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bc1e213-f023-49d3-885f-413472a17ba2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.078452] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bc1e213-f023-49d3-885f-413472a17ba2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.098569] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.099152] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.099757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.100121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.100336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.100566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.137977] env[62909]: INFO networking_nsxv3.common.synchronization [req-7081fb30-9229-4cbe-84ff-3b560deccf53 req-e60fa32c-6b7e-49d0-8145-8604a853954c service nova] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_rules [ 940.137977] env[62909]: INFO networking_nsxv3.common.synchronization [req-7081fb30-9229-4cbe-84ff-3b560deccf53 req-e60fa32c-6b7e-49d0-8145-8604a853954c service nova] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 940.138088] env[62909]: INFO networking_nsxv3.common.synchronization [req-7081fb30-9229-4cbe-84ff-3b560deccf53 req-e60fa32c-6b7e-49d0-8145-8604a853954c service nova] Enqueued Resource ID: 27d5fb42-82df-4642-9ddc-5a34ed445dfc with Priority: HIGHEST for action port [ 940.138645] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_rules [ 940.138732] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 940.138849] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27d5fb42-82df-4642-9ddc-5a34ed445dfc with Priority: HIGHEST for action port [ 940.139232] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.139440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.139880] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.139880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.140597] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-27d5fb42-82df-4642-9ddc-5a34ed445dfc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.140597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27d5fb42-82df-4642-9ddc-5a34ed445dfc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.140597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27d5fb42-82df-4642-9ddc-5a34ed445dfc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.140597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27d5fb42-82df-4642-9ddc-5a34ed445dfc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.140597] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27d5fb42-82df-4642-9ddc-5a34ed445dfc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.365703] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.366084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.366217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.366496] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.366700] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.367092] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.367288] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.367393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.367608] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.367739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.367868] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05b8610-e099-492a-a795-e90ed01da010 is going to be deleted. [ 940.399046] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.399313] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.399313] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.399465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.399531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.399593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.400144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.400797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.400797] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.400797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.400797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.400797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.400797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.401196] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a05b8610-e099-492a-a795-e90ed01da010',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.469339] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: SUCCESS [ 940.469339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.581430] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bc1e213-f023-49d3-885f-413472a17ba2 [ 940.581881] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.582045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.582165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.582419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.582570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.582721] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bc1e213-f023-49d3-885f-413472a17ba2 already deleted. [ 940.582835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bc1e213-f023-49d3-885f-413472a17ba2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.643818] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27d5fb42-82df-4642-9ddc-5a34ed445dfc with status ACTIVE [ 940.644202] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.644274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.644319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.644614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.644714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.645032] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.645179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.645417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.645688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.646504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.646824] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.646959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.647104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.647646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.647926] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.648035] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27d5fb42-82df-4642-9ddc-5a34ed445dfc is going to be updated. [ 940.676688] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.676798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.677127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.677127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.677283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.677513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27d5fb42-82df-4642-9ddc-5a34ed445dfc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.904199] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.904375] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.904421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.904642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.904732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.904921] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.905038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.905089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.909434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.909434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.909434] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a05b8610-e099-492a-a795-e90ed01da010 already deleted. [ 940.909434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a05b8610-e099-492a-a795-e90ed01da010" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.910972] env[62909]: INFO networking_nsxv3.common.synchronization [None req-63813b97-d7a5-4806-a761-9f4e62c0018d tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 5cbee7c9-ebc8-4b77-8a40-4665161f3c94 with Priority: HIGHEST for action security_group_rules [ 940.911663] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cbee7c9-ebc8-4b77-8a40-4665161f3c94 with Priority: HIGHEST for action security_group_rules [ 940.912045] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5cbee7c9-ebc8-4b77-8a40-4665161f3c94 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.912176] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5cbee7c9-ebc8-4b77-8a40-4665161f3c94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.912249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5cbee7c9-ebc8-4b77-8a40-4665161f3c94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.912521] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5cbee7c9-ebc8-4b77-8a40-4665161f3c94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.912594] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5cbee7c9-ebc8-4b77-8a40-4665161f3c94',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.009437] env[62909]: INFO networking_nsxv3.common.synchronization [None req-0e33ac54-2d6d-4746-85af-213c21dde67a tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 5cbee7c9-ebc8-4b77-8a40-4665161f3c94 with Priority: HIGHEST for action security_group_rules [ 941.010303] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cbee7c9-ebc8-4b77-8a40-4665161f3c94 with Priority: HIGHEST for action security_group_rules [ 941.010485] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5cbee7c9-ebc8-4b77-8a40-4665161f3c94 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.010631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5cbee7c9-ebc8-4b77-8a40-4665161f3c94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.153930] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 941.154312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.154356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.154554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.154750] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.154969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.154969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.155100] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.155510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.155663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.157544] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.157544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.157544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.157544] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.157544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.157544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.157544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.157544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.157544] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.438440] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.438575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.438611] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.438817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.439130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.439130] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5cbee7c9-ebc8-4b77-8a40-4665161f3c94 already deleted. [ 941.439130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5cbee7c9-ebc8-4b77-8a40-4665161f3c94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.439285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5cbee7c9-ebc8-4b77-8a40-4665161f3c94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.439424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5cbee7c9-ebc8-4b77-8a40-4665161f3c94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.439515] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5cbee7c9-ebc8-4b77-8a40-4665161f3c94',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.660358] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.663513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.663513] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.091706] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.091955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.091955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.092830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.092830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.092830] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5cbee7c9-ebc8-4b77-8a40-4665161f3c94 already deleted. [ 942.092830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5cbee7c9-ebc8-4b77-8a40-4665161f3c94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.165120] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.668196] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.668433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.668433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.668741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.668839] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.668901] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 942.713032] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.713032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.713032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.713032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.713032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.725519] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 942.870436] env[62909]: INFO networking_nsxv3.common.synchronization [None req-fd8fb116-abca-4607-aaf0-6874e7849e31 None None] Enqueued Resource ID: 2d6db485-b6f0-4afc-87d9-da907dcfb02e with Priority: HIGHEST for action port [ 942.870729] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d6db485-b6f0-4afc-87d9-da907dcfb02e with Priority: HIGHEST for action port [ 942.871278] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d6db485-b6f0-4afc-87d9-da907dcfb02e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.871278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d6db485-b6f0-4afc-87d9-da907dcfb02e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.871278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d6db485-b6f0-4afc-87d9-da907dcfb02e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.871560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d6db485-b6f0-4afc-87d9-da907dcfb02e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.871560] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6db485-b6f0-4afc-87d9-da907dcfb02e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.114033] env[62909]: INFO networking_nsxv3.common.synchronization [req-bec723d2-11d3-4693-b18e-11ee12e16a65 req-089afcf1-ea66-4cae-93c6-b68eebf75351 tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 943.114769] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 943.116552] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.117374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.117374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.117374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.117619] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.118192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.118192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.118192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.118192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.118192] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.374339] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d6db485-b6f0-4afc-87d9-da907dcfb02e [ 943.374786] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.374786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.375061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.375166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.375310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.375439] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d6db485-b6f0-4afc-87d9-da907dcfb02e already deleted. [ 943.375556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d6db485-b6f0-4afc-87d9-da907dcfb02e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.494234] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.494234] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.494489] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.494948] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.494948] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.495277] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.495431] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.495682] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.495850] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.496205] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.496356] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.496473] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.496588] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.496723] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.498072] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.498072] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.520774] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.520942] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 943.521149] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.521279] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.521781] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-464c2387-9349-42aa-bab6-3d349ca0ed26 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.522866] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-464c2387-9349-42aa-bab6-3d349ca0ed26" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.522866] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-464c2387-9349-42aa-bab6-3d349ca0ed26" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.522866] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-464c2387-9349-42aa-bab6-3d349ca0ed26" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.523374] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('464c2387-9349-42aa-bab6-3d349ca0ed26',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.622551] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.032282] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.032282] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.032282] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.032282] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.032640] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.032640] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 464c2387-9349-42aa-bab6-3d349ca0ed26 not found, creating... [ 944.033179] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.033485] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.033622] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.034862] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.034862] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.034862] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.035208] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.035685] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.035876] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.036165] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.036445] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 464c2387-9349-42aa-bab6-3d349ca0ed26 is going to be created. [ 944.059981] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.060236] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.060388] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.060689] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.060969] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.061237] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-464c2387-9349-42aa-bab6-3d349ca0ed26" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.125440] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.630171] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.630171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.630171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.630171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.630171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.630171] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 944.663051] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.664146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.664146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.664788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.664973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.676764] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 944.738776] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 944.738776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.738776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.739883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.739883] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.739883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.739883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.739883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.739883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.739883] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.804643] env[62909]: INFO networking_nsxv3.common.synchronization [req-bec723d2-11d3-4693-b18e-11ee12e16a65 req-d539e97f-d441-4610-8c3d-edc31a67c6c1 service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 944.804886] env[62909]: INFO networking_nsxv3.common.synchronization [req-bec723d2-11d3-4693-b18e-11ee12e16a65 req-d539e97f-d441-4610-8c3d-edc31a67c6c1 service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 944.805193] env[62909]: INFO networking_nsxv3.common.synchronization [req-bec723d2-11d3-4693-b18e-11ee12e16a65 req-d539e97f-d441-4610-8c3d-edc31a67c6c1 service nova] Enqueued Resource ID: 464c2387-9349-42aa-bab6-3d349ca0ed26 with Priority: HIGHEST for action port [ 944.805423] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 944.805484] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 944.805665] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 464c2387-9349-42aa-bab6-3d349ca0ed26 with Priority: HIGHEST for action port [ 944.806351] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.806443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.806494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.806808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.806923] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.808678] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.809036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.809321] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-464c2387-9349-42aa-bab6-3d349ca0ed26 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.809479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-464c2387-9349-42aa-bab6-3d349ca0ed26" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.809571] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-464c2387-9349-42aa-bab6-3d349ca0ed26" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.809858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-464c2387-9349-42aa-bab6-3d349ca0ed26" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.809908] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('464c2387-9349-42aa-bab6-3d349ca0ed26',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.242597] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.312153] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.312335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.314709] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 464c2387-9349-42aa-bab6-3d349ca0ed26 with status ACTIVE [ 945.314953] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.315121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.315200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.315457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.315562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.315769] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.315895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.315967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.316170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.316251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.316430] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.316517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.316581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.316726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.316801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.316874] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 464c2387-9349-42aa-bab6-3d349ca0ed26 is going to be updated. [ 945.348160] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.348314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.348384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.348618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.348804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.348937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-464c2387-9349-42aa-bab6-3d349ca0ed26" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.746717] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.251267] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.251486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.251486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.253699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.253699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.253699] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 946.287599] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.287755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.287887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.288125] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.288309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.307954] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 946.427354] env[62909]: INFO networking_nsxv3.common.synchronization [req-29240860-38f4-4cd5-85ae-f31ea22eb85f req-30051c5a-d6c8-45c1-955f-4d27b9052d1b tempest-ServersNegativeTestJSON-170677023 tempest-ServersNegativeTestJSON-170677023-project-member] Enqueued Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 946.427354] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 946.427354] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.427354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.427354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.427354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.427354] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.427354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.427354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.427354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.427354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.427354] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.581823] env[62909]: INFO networking_nsxv3.common.synchronization [req-88493e8f-78c3-4341-a953-4ada19d478d2 req-d5ce5026-e424-4bf6-8dae-939ca2741c6a tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 946.582478] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 946.582922] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.583078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.583154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.583604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.583604] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.583826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.583826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.584021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.584153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.584272] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.695466] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 946.695825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.696061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.696303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.696496] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.696614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.696709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.696924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.697022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.697123] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.930559] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.086715] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.086715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.086927] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.087039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.112532] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.112927] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.112927] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.113113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.113297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.113415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.114745] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 947.145659] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.145659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.145659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.145954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.146561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.158653] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 947.201928] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.434016] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.706665] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.936516] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.936847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.936847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.936921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.937142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.937142] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd is going to be updated. [ 947.978230] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.978230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.978230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.978230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.978230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.992255] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: IN_PROGRESS for 2s [ 948.208378] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.208603] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.208693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.208909] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.208995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.209099] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 948.247639] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.247818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.247926] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.248146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.248355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.259021] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 948.323770] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 948.323982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.324174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.324387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.324585] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.324700] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.324766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.324956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.325028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.325099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.325259] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.325353] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.325412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.325563] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.325704] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.325794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.325854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.325987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.330225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.330351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.330455] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.832449] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3c6858c-f90d-4b04-bbda-341ff7525e29: rpc.has_security_group_logging(os_id): False [ 948.860128] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.860260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.860326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.860540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.860627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.860793] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.860909] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.861062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.861234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.861309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.861513] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.861603] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.861664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.861797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.861859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.864825] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.865675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.865792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.866195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.866375] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.866502] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 949.035986] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.035986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.037027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.037120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.037254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.060528] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 949.173296] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 949.173516] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f deletion is rescheduled due to dependency. [ 949.173593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.999034] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: SUCCESS [ 949.999034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.269307] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 950.269679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.269679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.269921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 950.270134] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.270250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 950.270314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.270503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 950.270588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.270678] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.270772] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.773439] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.773635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 950.773727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.774041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 950.774335] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.774579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 950.774693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.774892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 950.774985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.775095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.775369] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.777339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 950.777486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.777664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 950.777857] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.778073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 950.778203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.778430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 950.778534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.778652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.778755] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.090769] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 951.090968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.091188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.091412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.091496] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.281474] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57568fd4-ee2b-43e3-a228-9a168490f0f5: rpc.has_security_group_logging(os_id): False [ 951.301855] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.301998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.302085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.302369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.331997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.331997] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.331997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.331997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.331997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.331997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.333398] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.333398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.334578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.334578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.334578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.334578] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.334578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.334578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.337439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.337439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.337439] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 951.343321] env[62909]: INFO networking_nsxv3.common.synchronization [req-fdc4cac1-6467-4000-bea7-250ec5364fe6 req-e8605d67-550c-42ea-8476-0c6f4926f9a8 tempest-ServersAdminTestJSON-1709758822 tempest-ServersAdminTestJSON-1709758822-project-member] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 951.343482] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 951.343793] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.343913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.344428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.349296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.349525] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.349902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.349902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.349902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.350037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.350106] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.403772] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.403912] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.403989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.404222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.404374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.424875] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 951.596292] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.596643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.596762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.596982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.597156] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.597258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.597340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.597486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.597568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.597652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.597738] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.875773] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.983607] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-13 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.984168] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.984311] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.984772] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.985095] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.985095] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.985241] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.987018] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.987018] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.987018] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.987018] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.987018] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.987018] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.987018] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.987018] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.987018] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.009353] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.009579] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 952.009763] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.009982] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-13" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.011574] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-8963aef9-1731-4bd4-b659-83eb9724f8f9 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.011574] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-8963aef9-1731-4bd4-b659-83eb9724f8f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.011574] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-8963aef9-1731-4bd4-b659-83eb9724f8f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.011574] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-8963aef9-1731-4bd4-b659-83eb9724f8f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.011574] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8963aef9-1731-4bd4-b659-83eb9724f8f9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.100897] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.101135] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.101218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.101440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.101605] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.101708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.101773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.101929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.102037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.102152] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.102320] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.102413] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.102473] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.102607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.102745] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.102828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.102888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.103038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.103119] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.103199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.103304] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.379703] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.517027] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.517027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.517027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.517027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.517027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.517027] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 8963aef9-1731-4bd4-b659-83eb9724f8f9 not found, creating... [ 952.517027] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.517027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.517027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.517027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.517027] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.517894] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.517894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.517894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.517894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.517894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.518203] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 8963aef9-1731-4bd4-b659-83eb9724f8f9 is going to be created. [ 952.543830] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.544490] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.544902] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.545240] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.545592] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.545866] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-8963aef9-1731-4bd4-b659-83eb9724f8f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.606775] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3c6858c-f90d-4b04-bbda-341ff7525e29: rpc.has_security_group_logging(os_id): False [ 952.625224] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.625373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.625414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.625600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.625687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.625889] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.626444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.626656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.626862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.626976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.627247] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.627389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.627497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.627683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.628097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.628097] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.628097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.628253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.628463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.628463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.628595] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 952.763754] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.766893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.766893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.766893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.766893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.824396] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 952.885699] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.885699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.885699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.885699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.885699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.886245] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 952.937752] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.938067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.938067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.938263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.938452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.955430] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 952.977737] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e17cea73-7245-4a8c-aff7-3b9e8558bc67 None None] Enqueued Resource ID: 7bd7e5b7-71bb-4fa1-9aa5-b0a301249398 with Priority: HIGHEST for action port [ 952.978133] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bd7e5b7-71bb-4fa1-9aa5-b0a301249398 with Priority: HIGHEST for action port [ 952.982344] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bd7e5b7-71bb-4fa1-9aa5-b0a301249398 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.982673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bd7e5b7-71bb-4fa1-9aa5-b0a301249398" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.982673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bd7e5b7-71bb-4fa1-9aa5-b0a301249398" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.982806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bd7e5b7-71bb-4fa1-9aa5-b0a301249398" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.983236] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd7e5b7-71bb-4fa1-9aa5-b0a301249398',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.445627] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 953.445900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.474640] env[62909]: INFO networking_nsxv3.common.synchronization [req-fdc4cac1-6467-4000-bea7-250ec5364fe6 req-2038e242-5256-4e7a-9e9b-38ced141eadb service nova] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_rules [ 953.474640] env[62909]: INFO networking_nsxv3.common.synchronization [req-fdc4cac1-6467-4000-bea7-250ec5364fe6 req-2038e242-5256-4e7a-9e9b-38ced141eadb service nova] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 953.474640] env[62909]: INFO networking_nsxv3.common.synchronization [req-fdc4cac1-6467-4000-bea7-250ec5364fe6 req-2038e242-5256-4e7a-9e9b-38ced141eadb service nova] Enqueued Resource ID: 8963aef9-1731-4bd4-b659-83eb9724f8f9 with Priority: HIGHEST for action port [ 953.474640] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_rules [ 953.474640] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 953.474640] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8963aef9-1731-4bd4-b659-83eb9724f8f9 with Priority: HIGHEST for action port [ 953.476033] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.476033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.476033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.476033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.476033] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.477446] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.477545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.477760] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-8963aef9-1731-4bd4-b659-83eb9724f8f9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.477877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8963aef9-1731-4bd4-b659-83eb9724f8f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.477919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8963aef9-1731-4bd4-b659-83eb9724f8f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.478182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8963aef9-1731-4bd4-b659-83eb9724f8f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.478182] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8963aef9-1731-4bd4-b659-83eb9724f8f9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.488316] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bd7e5b7-71bb-4fa1-9aa5-b0a301249398 [ 953.490245] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.490390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.490457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.490670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.490754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.490868] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bd7e5b7-71bb-4fa1-9aa5-b0a301249398 already deleted. [ 953.490919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bd7e5b7-71bb-4fa1-9aa5-b0a301249398" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.980229] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.980229] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.984523] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8963aef9-1731-4bd4-b659-83eb9724f8f9 with status ACTIVE [ 953.984523] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.984523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.984523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.984523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.984523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.984523] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.984523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.984523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.984523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.984523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.984523] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.984523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.984523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.985136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.985136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.985136] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8963aef9-1731-4bd4-b659-83eb9724f8f9 is going to be updated. [ 954.009916] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.009916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.009916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.010314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.010314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.010314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8963aef9-1731-4bd4-b659-83eb9724f8f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.228934] env[62909]: INFO networking_nsxv3.common.synchronization [None req-2ac84ece-ed0e-4ab8-b8ff-14e6bbc8785b tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_rules [ 954.229629] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_rules [ 954.230087] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e666168c-26eb-4fba-8f02-30bb3eb590d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.230421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.230567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.230973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.231230] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.238016] env[62909]: INFO networking_nsxv3.common.synchronization [req-f7fd34a5-ae73-4f2a-9111-c97db9f9b2a8 req-6b369ffa-240c-41c4-ae06-8a3670a5a9a5 tempest-ListImageFiltersTestJSON-1708948366 tempest-ListImageFiltersTestJSON-1708948366-project-member] Enqueued Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 954.238016] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 954.238016] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.239297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.239297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.239297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.239297] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.239297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.239297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.239731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.239921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.240110] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.355426] env[62909]: INFO networking_nsxv3.common.synchronization [None req-3a6a2b39-94fe-427d-99bc-7c2f85e46511 tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_rules [ 954.356140] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_rules [ 954.356551] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e666168c-26eb-4fba-8f02-30bb3eb590d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.356752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.742508] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.753946] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.754141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.756430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.756430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.756430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.756430] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 already deleted. [ 954.756430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.756430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.756430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.756430] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.849598] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 954.849598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.967261] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 954.967485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.967661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.967896] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.968186] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.968319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.968319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.968489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.968489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.968596] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.245712] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.281773] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.281864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.281906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.282623] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.282724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.282813] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 already deleted. [ 955.282892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.431587] env[62909]: INFO networking_nsxv3.common.synchronization [req-63d5083f-bbad-468f-8e55-3a74c18fc89b req-248fce1f-d12e-4f14-8104-a03d6929dfa8 tempest-MultipleCreateTestJSON-1768884473 tempest-MultipleCreateTestJSON-1768884473-project-member] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 955.431587] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 955.431587] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.432222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.432352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.432679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.433615] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.434383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.434469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.434625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.434699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.434792] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.472546] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.571234] env[62909]: INFO networking_nsxv3.common.synchronization [req-6fe6e708-cf44-4f3f-80d0-d655562f16c3 req-fa7d3354-9317-4694-810b-5794b155733b tempest-MultipleCreateTestJSON-1768884473 tempest-MultipleCreateTestJSON-1768884473-project-member] Enqueued Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 955.571782] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 with Priority: HIGHEST for action security_group_members [ 955.572193] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6858c-f90d-4b04-bbda-341ff7525e29 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.572349] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.751511] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.751903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.751903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.752658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.752658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.752658] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb is going to be updated. [ 955.787481] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.787481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.787481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.787481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.787481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.797761] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: IN_PROGRESS for 2s [ 955.937661] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.974377] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.109326] env[62909]: INFO networking_nsxv3.common.synchronization [None req-67f6bab5-7d9d-410d-acc9-7f007cc6d727 None None] Enqueued Resource ID: 32d84ddd-8668-45ab-9a81-caa7f4f284de with Priority: HIGHEST for action port [ 956.109326] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d84ddd-8668-45ab-9a81-caa7f4f284de with Priority: HIGHEST for action port [ 956.109684] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-32d84ddd-8668-45ab-9a81-caa7f4f284de taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.110412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32d84ddd-8668-45ab-9a81-caa7f4f284de" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.110501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32d84ddd-8668-45ab-9a81-caa7f4f284de" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.110773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32d84ddd-8668-45ab-9a81-caa7f4f284de" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.110857] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32d84ddd-8668-45ab-9a81-caa7f4f284de',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.439530] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.476474] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.476690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.476690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.476886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.476976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.477087] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 956.506868] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.507010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.507085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.507365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.507522] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.518472] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 956.617946] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32d84ddd-8668-45ab-9a81-caa7f4f284de [ 956.618228] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.618379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.618379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.618664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.618825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.618983] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32d84ddd-8668-45ab-9a81-caa7f4f284de already deleted. [ 956.619155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32d84ddd-8668-45ab-9a81-caa7f4f284de" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.944864] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.944864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.944864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.944864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.944864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.944864] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 956.976402] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.977207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.982266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.982266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.982266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.993997] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 957.255896] env[62909]: INFO networking_nsxv3.common.synchronization [req-d1f53c5e-ef95-4491-a7cd-1279aaf21bb0 req-8fb616f5-6bc5-452c-b59c-3bf66ca3a8a6 tempest-ImagesTestJSON-652168268 tempest-ImagesTestJSON-652168268-project-member] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 957.256786] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 957.256897] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.257056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.257140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.257350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.257523] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.257709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.257709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.257831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.257912] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.258013] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.760206] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.760371] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.760482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.760672] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.760762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.760989] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.761146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.761207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.761370] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.761446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.761532] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 957.795116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.795116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.795116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.795365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.795457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.808387] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 957.809030] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: SUCCESS [ 957.809235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.171284] env[62909]: INFO networking_nsxv3.common.synchronization [req-274b67dc-b680-4ade-8a7e-12c27f45fdb8 req-50e07300-2c87-440d-adf0-c8aa5e1df0e8 tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 958.171807] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 958.172996] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.172996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.172996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.172996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.172996] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.172996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.172996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.172996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.173566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.173566] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.515227] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.515436] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.515567] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.515862] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.516142] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.516308] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.516429] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.516656] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.516803] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.517184] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.517359] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.517482] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.517601] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.517762] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.517862] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.517967] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.528831] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 958.529059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.529220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.529457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.529642] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.529753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.529819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.529970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.530060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.530145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.530478] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.537786] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.537962] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 958.538120] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.538299] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.538607] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-c3221de3-00d5-45e7-af68-04297360fbcf taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.538778] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.538925] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.539243] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.539386] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3221de3-00d5-45e7-af68-04297360fbcf',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.676164] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.004513] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 959.004675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.004819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.005059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.005274] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.005393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.005458] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.005619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.005699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.005792] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6858c-f90d-4b04-bbda-341ff7525e29',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.032684] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.032924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.032924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.033143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.033335] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.033452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.033517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.033673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.033759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.033847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.033998] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.034107] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.034178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.034304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.034436] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.034525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.034585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.034717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.034789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.034870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.034955] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.041544] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.041734] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.041734] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.041959] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.042194] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.042624] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.042895] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.043154] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.043420] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.043571] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.043867] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.044337] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.044571] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.044866] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.045026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.045192] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: c3221de3-00d5-45e7-af68-04297360fbcf is going to be updated. [ 959.066993] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.067331] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.067512] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.067792] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.067999] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.068293] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.178419] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.508232] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.508421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.508421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.508619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.508707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.509760] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.509760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.509760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.509760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.509760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.509760] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 is going to be updated. [ 959.538168] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5: rpc.has_security_group_logging(os_id): False [ 959.557475] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.557663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.557738] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.557950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.558110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.560042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.560179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.560219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.560401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.560476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.560664] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.560759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.560821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.561027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.561139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.561351] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.561449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.561511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.561653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.561726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.561905] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.561997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.562073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.562217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.562282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.562362] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 959.581825] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: IN_PROGRESS for 2s [ 959.667673] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.667673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.667673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.668116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.668116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.681668] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.681668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.681857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.681932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.682338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.682490] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 959.687373] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 959.732479] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.733024] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.733199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.733470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.733626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.756613] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 959.821490] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 959.821785] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa deletion is rescheduled due to dependency. [ 959.821785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.896906] env[62909]: INFO networking_nsxv3.common.synchronization [req-4c6f8042-4435-454c-8b62-9a70bb3e15c5 req-5fb4df71-a11c-40f7-a0c3-4b67b82fbc48 service nova] Enqueued Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_rules [ 959.897163] env[62909]: INFO networking_nsxv3.common.synchronization [req-4c6f8042-4435-454c-8b62-9a70bb3e15c5 req-5fb4df71-a11c-40f7-a0c3-4b67b82fbc48 service nova] Enqueued Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_members [ 959.897358] env[62909]: INFO networking_nsxv3.common.synchronization [req-4c6f8042-4435-454c-8b62-9a70bb3e15c5 req-5fb4df71-a11c-40f7-a0c3-4b67b82fbc48 service nova] Enqueued Resource ID: c3221de3-00d5-45e7-af68-04297360fbcf with Priority: HIGHEST for action port [ 959.897993] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_rules [ 959.898171] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_members [ 959.898305] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3221de3-00d5-45e7-af68-04297360fbcf with Priority: HIGHEST for action port [ 959.898675] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.899777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.899777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.899777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.899777] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.900370] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.900492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.900550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.900725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.900878] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.901000] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.901086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.901238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.901415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.901415] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.902222] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3221de3-00d5-45e7-af68-04297360fbcf taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.902326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.902392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.903076] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.903076] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3221de3-00d5-45e7-af68-04297360fbcf',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.409593] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.409999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.410057] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3221de3-00d5-45e7-af68-04297360fbcf with status ACTIVE [ 960.410300] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.410441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.410513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.410727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.410819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.411034] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.411281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.411281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.411404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.411485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.411703] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.411895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.411934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.412092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.412881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.412881] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3221de3-00d5-45e7-af68-04297360fbcf is going to be updated. [ 960.413770] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.441713] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.441713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.442193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.442590] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.442811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.443137] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3221de3-00d5-45e7-af68-04297360fbcf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.916082] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.418420] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.418765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.418765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.418887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.418982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.419110] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d711f143-3c86-4518-9590-301f0739c6ea is going to be updated. [ 961.451907] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.451907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.451907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.451907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.451907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.462337] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d711f143-3c86-4518-9590-301f0739c6ea in Status: IN_PROGRESS for 2s [ 961.586937] env[62909]: INFO networking_nsxv3.common.synchronization [req-bb58eb02-64e4-4023-b0b1-1af24f427632 req-7df86abb-512e-4c24-bd45-c08ead9f7e8f tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 961.587493] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 961.588214] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.588369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.588439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.588624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.588777] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.588878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.588955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.589084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.589167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.589260] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.597035] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 in Status: SUCCESS [ 961.597242] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6858c-f90d-4b04-bbda-341ff7525e29 deletion is rescheduled due to dependency. [ 961.597317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6858c-f90d-4b04-bbda-341ff7525e29" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.705456] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 961.705456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.769965] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 961.769965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.958396] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.960107] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.960107] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.960107] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.960234] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.960548] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.960672] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.961515] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.961680] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.961960] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.962184] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.962284] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.962379] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.962878] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.963074] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.963931] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.987020] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.987020] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 961.987020] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.987020] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.987020] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-b2fe080d-6273-4a2c-b4dc-2d9ec37d4161 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.987020] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-b2fe080d-6273-4a2c-b4dc-2d9ec37d4161" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.987020] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-b2fe080d-6273-4a2c-b4dc-2d9ec37d4161" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.987020] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-b2fe080d-6273-4a2c-b4dc-2d9ec37d4161" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.987020] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2fe080d-6273-4a2c-b4dc-2d9ec37d4161',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.094507] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.094674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.094745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.094959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.095061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.095265] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.095364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.095457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.095574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.095649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.095732] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 already deleted. [ 962.095813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.490723] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.491103] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.491103] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.491428] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.491577] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.491737] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port b2fe080d-6273-4a2c-b4dc-2d9ec37d4161 not found, creating... [ 962.492046] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.492221] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.492340] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.492565] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.492809] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.492984] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.493171] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.493292] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.493512] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.493711] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.493779] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: b2fe080d-6273-4a2c-b4dc-2d9ec37d4161 is going to be created. [ 962.514350] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.514563] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.514682] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.514960] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.515297] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.515532] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-b2fe080d-6273-4a2c-b4dc-2d9ec37d4161" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.257086] env[62909]: INFO networking_nsxv3.common.synchronization [req-bb58eb02-64e4-4023-b0b1-1af24f427632 req-1fcf19ad-ad9c-41ef-8e4e-2ee15e61b66b service nova] Enqueued Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_rules [ 963.257283] env[62909]: INFO networking_nsxv3.common.synchronization [req-bb58eb02-64e4-4023-b0b1-1af24f427632 req-1fcf19ad-ad9c-41ef-8e4e-2ee15e61b66b service nova] Enqueued Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 963.257425] env[62909]: INFO networking_nsxv3.common.synchronization [req-bb58eb02-64e4-4023-b0b1-1af24f427632 req-1fcf19ad-ad9c-41ef-8e4e-2ee15e61b66b service nova] Enqueued Resource ID: b2fe080d-6273-4a2c-b4dc-2d9ec37d4161 with Priority: HIGHEST for action port [ 963.257996] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_rules [ 963.259198] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 963.259362] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2fe080d-6273-4a2c-b4dc-2d9ec37d4161 with Priority: HIGHEST for action port [ 963.259697] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.259865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.259967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.260274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.260403] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.261431] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.263344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.263344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.263344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.263344] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.263344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.263344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.263344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.263344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.263344] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.263344] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2fe080d-6273-4a2c-b4dc-2d9ec37d4161 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.263344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2fe080d-6273-4a2c-b4dc-2d9ec37d4161" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.263852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2fe080d-6273-4a2c-b4dc-2d9ec37d4161" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.263852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2fe080d-6273-4a2c-b4dc-2d9ec37d4161" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.264192] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2fe080d-6273-4a2c-b4dc-2d9ec37d4161',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.473052] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d711f143-3c86-4518-9590-301f0739c6ea in Status: SUCCESS [ 963.473052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.473052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.473343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.473343] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.473442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.473495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.473636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.473711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.473793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.473884] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.765832] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.768025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.768025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.768025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2fe080d-6273-4a2c-b4dc-2d9ec37d4161 with status ACTIVE [ 963.768025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.768377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.768377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.768635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.768751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.769063] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.769268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.769638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.769682] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.769843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.770170] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.770356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.770463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.770777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.770818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.771370] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2fe080d-6273-4a2c-b4dc-2d9ec37d4161 is going to be updated. [ 963.794661] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.794857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.794857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.795081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.795228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.795395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2fe080d-6273-4a2c-b4dc-2d9ec37d4161" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.976075] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.269025] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.477923] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d711f143-3c86-4518-9590-301f0739c6ea: rpc.has_security_group_logging(os_id): False [ 964.496380] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.496640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.496640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.496763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.519653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.519653] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.519653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.519653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.519653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.519653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.519653] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d711f143-3c86-4518-9590-301f0739c6ea is going to be updated. [ 964.583201] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.583431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.583431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.584342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.584342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.595908] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d711f143-3c86-4518-9590-301f0739c6ea in Status: IN_PROGRESS for 2s [ 964.771285] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.771761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.771761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.771761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.771900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.771973] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 is going to be created. [ 964.808701] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.808956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.809454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.809454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.809454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.821626] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: UNINITIALIZED for 2s [ 966.613486] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d711f143-3c86-4518-9590-301f0739c6ea in Status: SUCCESS [ 966.613761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.837330] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: SUCCESS [ 966.837539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.837709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.837967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.838147] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.838284] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.838352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.838519] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.838631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.838703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.839108] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.341239] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.341418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.341486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.341681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.341917] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.342076] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.342076] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.342217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.342217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.342330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.342932] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.342932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.342932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.342932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.342932] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.342932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.343236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.343236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.343236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.343323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.343384] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.847329] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d9e8226-da60-440e-9104-6faa87b1a100: rpc.has_security_group_logging(os_id): False [ 967.868805] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.868958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.869031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.869299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.869376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.869657] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.869872] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.869872] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.870068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.870210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.870485] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.870617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.870774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.870856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.870959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.871408] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.871575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.871695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.871890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.872060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.872157] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 is going to be created. [ 967.957259] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.957429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.957472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.957690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.957876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.978386] env[62909]: INFO networking_nsxv3.common.synchronization [req-1329149c-1ea6-433b-a1e9-d36681f23451 req-a82400c1-020d-45d0-b224-6ce4770820d2 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 967.980330] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: IN_PROGRESS for 2s [ 967.980330] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 967.980913] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.980913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.980913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.981162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.981221] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.981300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.981364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.981932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.981932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.981932] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.318307] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.319070] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.319070] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.319416] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.319645] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.319813] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.319936] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.320191] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.320342] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.321077] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.321077] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.321077] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.321077] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.321077] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.321331] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.321368] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.342663] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.342900] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 968.343092] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.343302] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.343677] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-de62c681-4ead-4636-8a49-3bcab66952b9 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.343870] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-de62c681-4ead-4636-8a49-3bcab66952b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.343994] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-de62c681-4ead-4636-8a49-3bcab66952b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.344357] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-de62c681-4ead-4636-8a49-3bcab66952b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.344502] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de62c681-4ead-4636-8a49-3bcab66952b9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.484222] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.847342] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.847646] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.847749] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.848033] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.848211] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.848379] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port de62c681-4ead-4636-8a49-3bcab66952b9 not found, creating... [ 968.848658] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.848845] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.848994] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.849250] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.849389] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.849680] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.849837] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.849955] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.850183] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.850318] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.851836] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: de62c681-4ead-4636-8a49-3bcab66952b9 is going to be created. [ 968.872037] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.872037] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.872037] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.872349] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.872460] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.872731] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-de62c681-4ead-4636-8a49-3bcab66952b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.987809] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.490890] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.490890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.490890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.491560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.491560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.492505] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 is going to be updated. [ 969.520210] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.520351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.520462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.520621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.520785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.533270] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: IN_PROGRESS for 2s [ 969.589503] env[62909]: INFO networking_nsxv3.common.synchronization [req-1329149c-1ea6-433b-a1e9-d36681f23451 req-95e0b512-776a-4c66-8036-e7dc15a7dc0e service nova] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_rules [ 969.589503] env[62909]: INFO networking_nsxv3.common.synchronization [req-1329149c-1ea6-433b-a1e9-d36681f23451 req-95e0b512-776a-4c66-8036-e7dc15a7dc0e service nova] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 969.589503] env[62909]: INFO networking_nsxv3.common.synchronization [req-1329149c-1ea6-433b-a1e9-d36681f23451 req-95e0b512-776a-4c66-8036-e7dc15a7dc0e service nova] Enqueued Resource ID: de62c681-4ead-4636-8a49-3bcab66952b9 with Priority: HIGHEST for action port [ 969.589503] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_rules [ 969.589503] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 969.589503] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de62c681-4ead-4636-8a49-3bcab66952b9 with Priority: HIGHEST for action port [ 969.589980] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.590252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.590432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.590743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.591103] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.592804] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.593154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.594058] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-de62c681-4ead-4636-8a49-3bcab66952b9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.594058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de62c681-4ead-4636-8a49-3bcab66952b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.594058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de62c681-4ead-4636-8a49-3bcab66952b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.594058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de62c681-4ead-4636-8a49-3bcab66952b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.594058] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de62c681-4ead-4636-8a49-3bcab66952b9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.992387] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: SUCCESS [ 969.992662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.094050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.094050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.095539] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de62c681-4ead-4636-8a49-3bcab66952b9 with status ACTIVE [ 970.095664] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.095819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.095906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.096214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.096418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.096640] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.096775] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.096935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.097178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.097320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.097621] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.097758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.097819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.098012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.098110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.098501] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de62c681-4ead-4636-8a49-3bcab66952b9 is going to be updated. [ 970.123264] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.123264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.123264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.123264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.123264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.123264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de62c681-4ead-4636-8a49-3bcab66952b9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.561638] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: SUCCESS [ 971.562090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.562090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.562414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.562520] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.562600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.562651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.562779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.562848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.562937] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.066070] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.569754] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.072896] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.073138] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.073138] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.073487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.073612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.073717] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 is going to be updated. [ 973.111890] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.112157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.112157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.112429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.112584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.124046] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: IN_PROGRESS for 2s [ 974.589819] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 974.590203] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 974.826796] env[62909]: INFO networking_nsxv3.common.synchronization [req-693d102d-51b0-4c5b-9c00-b4b90d6a4d78 req-c60c47ad-2ae8-4dc3-a20e-32a9b1078a72 tempest-ImagesOneServerNegativeTestJSON-373251561 tempest-ImagesOneServerNegativeTestJSON-373251561-project-member] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 974.827430] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 974.827681] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.827803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.827865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.828134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.828672] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.828794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.829541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.829541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.829541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.829541] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.137162] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: SUCCESS [ 975.137162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.137162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.137162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.137162] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.137162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.137508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.137508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.137508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.137508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.137628] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.140151] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.140346] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.140501] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.140869] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.141218] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.141392] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.141596] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.141752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.141902] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.142164] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.142285] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.142399] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.142523] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.142639] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.142749] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.142880] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.162327] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.162572] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 975.162718] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.162903] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.163296] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-771b1fec-a03e-465e-93bb-e565d996e361 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.163976] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-771b1fec-a03e-465e-93bb-e565d996e361" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.163976] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-771b1fec-a03e-465e-93bb-e565d996e361" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.164118] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-771b1fec-a03e-465e-93bb-e565d996e361" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.164168] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('771b1fec-a03e-465e-93bb-e565d996e361',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.333158] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.333380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.333531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.333760] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.333902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.334150] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.334269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.334351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.334524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.334595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.334715] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc already deleted. [ 975.334807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.645490] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.666630] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.666935] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.667121] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.667478] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.667721] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.668452] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 771b1fec-a03e-465e-93bb-e565d996e361 not found, creating... [ 975.668452] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.668452] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.668733] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.669100] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.669100] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.669389] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.669561] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.669680] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.669935] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.670056] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.670202] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 771b1fec-a03e-465e-93bb-e565d996e361 is going to be created. [ 975.698728] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.699203] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.699291] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.699803] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.700522] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.700636] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-771b1fec-a03e-465e-93bb-e565d996e361" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.149749] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7b8e547-f24c-4b71-8565-214f37cb5c01: rpc.has_security_group_logging(os_id): False [ 976.174922] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.175067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.175161] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.175396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.175501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.175754] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.175858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.175923] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.176120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.176650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.176650] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 is going to be updated. [ 976.277630] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.277852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.277852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.277986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.278118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.293532] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: IN_PROGRESS for 2s [ 976.448336] env[62909]: INFO networking_nsxv3.common.synchronization [req-693d102d-51b0-4c5b-9c00-b4b90d6a4d78 req-eb1ac8b7-a71e-4a03-9268-187cabea9e94 service nova] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_rules [ 976.448518] env[62909]: INFO networking_nsxv3.common.synchronization [req-693d102d-51b0-4c5b-9c00-b4b90d6a4d78 req-eb1ac8b7-a71e-4a03-9268-187cabea9e94 service nova] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 976.448668] env[62909]: INFO networking_nsxv3.common.synchronization [req-693d102d-51b0-4c5b-9c00-b4b90d6a4d78 req-eb1ac8b7-a71e-4a03-9268-187cabea9e94 service nova] Enqueued Resource ID: 771b1fec-a03e-465e-93bb-e565d996e361 with Priority: HIGHEST for action port [ 976.449763] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_rules [ 976.450049] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 976.450270] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 771b1fec-a03e-465e-93bb-e565d996e361 with Priority: HIGHEST for action port [ 976.452339] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.452339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.452339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.452339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.452339] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.452644] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.452763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.452809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.452960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.453119] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.453212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.453307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.453573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.453676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.453724] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.454505] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-771b1fec-a03e-465e-93bb-e565d996e361 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.454632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-771b1fec-a03e-465e-93bb-e565d996e361" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.454687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-771b1fec-a03e-465e-93bb-e565d996e361" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.454816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-771b1fec-a03e-465e-93bb-e565d996e361" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.454881] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('771b1fec-a03e-465e-93bb-e565d996e361',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.957309] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.957823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.957823] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.958673] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 771b1fec-a03e-465e-93bb-e565d996e361 with status ACTIVE [ 976.959460] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.959460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.959460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.959716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.959971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.960021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.960135] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.960198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.960421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.960507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.960745] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.960870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.960938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.961191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.961263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.961607] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 771b1fec-a03e-465e-93bb-e565d996e361 is going to be updated. [ 976.983678] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.983914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.984050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.984279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.984488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.984683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-771b1fec-a03e-465e-93bb-e565d996e361" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.420139] env[62909]: INFO networking_nsxv3.common.synchronization [req-9757ece4-a58a-495e-babb-d2bb865948d6 req-c6cd2cd7-0148-4d72-b70c-78f026c5d3e7 tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 977.421147] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 977.421462] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.421600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.421649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.421854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.422023] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.422680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.422773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.422930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.423027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.423136] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.464304] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.765919] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.766417] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.766666] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.767141] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.767545] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.768029] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.768378] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.768821] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.769162] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.769540] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.769858] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.770171] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.770470] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.770716] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.770926] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.771445] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.791778] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.791991] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 977.792152] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.792380] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.792703] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-2295762d-8e27-469d-a292-9ef453b210d6 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.792887] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-2295762d-8e27-469d-a292-9ef453b210d6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.793017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-2295762d-8e27-469d-a292-9ef453b210d6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.793373] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-2295762d-8e27-469d-a292-9ef453b210d6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.793548] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2295762d-8e27-469d-a292-9ef453b210d6',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.925928] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.926119] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.926192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.926414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.926505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.926706] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.926808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.927160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.927160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.927160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.927254] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 977.958685] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.959114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.959114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.959279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.959429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.967200] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.967352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.967396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.967587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.967673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.967768] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be created. [ 977.970174] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 977.992563] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.992733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.992785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.992975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.993150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.004232] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: UNINITIALIZED for 2s [ 978.297096] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.297096] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.297096] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.297793] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.299040] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.299040] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 2295762d-8e27-469d-a292-9ef453b210d6 not found, creating... [ 978.299198] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.299342] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.299549] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.299685] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.299952] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.300244] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.300342] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.300490] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.300756] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.300917] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.301178] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 2295762d-8e27-469d-a292-9ef453b210d6 is going to be created. [ 978.327067] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: SUCCESS [ 978.327372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.335320] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.335661] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.335829] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.336214] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.336499] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.336812] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-2295762d-8e27-469d-a292-9ef453b210d6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.057203] env[62909]: INFO networking_nsxv3.common.synchronization [req-9757ece4-a58a-495e-babb-d2bb865948d6 req-e1338b09-1deb-4005-bca8-a68e6b9cff14 service nova] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_rules [ 979.057573] env[62909]: INFO networking_nsxv3.common.synchronization [req-9757ece4-a58a-495e-babb-d2bb865948d6 req-e1338b09-1deb-4005-bca8-a68e6b9cff14 service nova] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 979.057721] env[62909]: INFO networking_nsxv3.common.synchronization [req-9757ece4-a58a-495e-babb-d2bb865948d6 req-e1338b09-1deb-4005-bca8-a68e6b9cff14 service nova] Enqueued Resource ID: 2295762d-8e27-469d-a292-9ef453b210d6 with Priority: HIGHEST for action port [ 979.058238] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_rules [ 979.058485] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 979.058615] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2295762d-8e27-469d-a292-9ef453b210d6 with Priority: HIGHEST for action port [ 979.058935] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.059074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.059159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.059367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.059447] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.060528] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.060528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.060707] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-2295762d-8e27-469d-a292-9ef453b210d6 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.060825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2295762d-8e27-469d-a292-9ef453b210d6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.060825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2295762d-8e27-469d-a292-9ef453b210d6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.063837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2295762d-8e27-469d-a292-9ef453b210d6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.063837] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2295762d-8e27-469d-a292-9ef453b210d6',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.565055] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.565055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.569070] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2295762d-8e27-469d-a292-9ef453b210d6 with status ACTIVE [ 979.569070] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.569070] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.569070] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.569070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.569070] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2295762d-8e27-469d-a292-9ef453b210d6 is going to be updated. [ 979.595726] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.595932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.596045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.596327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.596540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.596942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2295762d-8e27-469d-a292-9ef453b210d6" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.982638] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 979.982833] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f deletion is rescheduled due to dependency. [ 979.982946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.983129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.983364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.983549] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.983664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.983749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.983922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.984010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.984114] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.014468] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: SUCCESS [ 980.014693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.014854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.015085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.015286] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.015420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.015485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.015644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.015721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.015804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.015894] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.487139] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.518895] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.519223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.519319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.519549] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.519726] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.519836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.519899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.520327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.520327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.520327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.520488] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.520488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.520566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.520672] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.520807] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.520894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.520951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.521145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.521253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.521336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.521424] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.991459] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.023461] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc: rpc.has_security_group_logging(os_id): False [ 981.046949] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.046949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.046949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.046949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.046949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.047331] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.047428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.047536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.047828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.047930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.048277] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.048386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.050713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.050713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.050713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.050713] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.050713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.050713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.050713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.050713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.050713] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be created. [ 981.076461] env[62909]: INFO networking_nsxv3.common.synchronization [None req-c8368406-41c4-4a27-804a-661d91f90d1f tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 981.077024] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 981.078395] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.078395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.078395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.078395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.078395] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.078395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.078395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.078395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.078395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.078395] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.138512] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.138768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.138768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.138923] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.139147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.153459] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: IN_PROGRESS for 2s [ 981.497208] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.497208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.497757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.497757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.497757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.497757] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 981.534197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.534452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.534586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.534887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.535143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.548145] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 981.587157] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.587157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.587157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.587157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.610558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.610558] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.610558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.610558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.610558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.610558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.610558] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 981.645920] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.646297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.646297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.646518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.646662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.659721] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 983.171350] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: SUCCESS [ 983.171350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.559299] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 983.559523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.559710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.559886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.560083] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.560199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.560270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.560413] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.560485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.560567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.560657] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.672358] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 983.672358] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 deletion is rescheduled due to dependency. [ 983.672658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.067035] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.067269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.071312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.071514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.071727] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.071873] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.071931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.072128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.072285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.072442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.072843] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.072843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.072843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.072843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.073227] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.073227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.073227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.073497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.073497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.073497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.073740] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.575687] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f6e0db7-41ba-43f5-b841-2551ea96a39f: rpc.has_security_group_logging(os_id): False [ 984.597407] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.597600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.597640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.597850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.598241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.598241] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.598241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.598444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.598444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.598557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.598693] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.598791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.598865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.599088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.599243] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.599307] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.599432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.599474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.599594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.599663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.599749] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 984.704454] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.704635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.704676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.704886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.705073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.728378] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 986.078306] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 986.078789] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 986.486853] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.486853] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.486853] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.487539] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.487539] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.487846] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.487933] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.488218] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.488477] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.488715] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.488853] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.488951] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.489109] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.489295] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.489461] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.489630] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.510018] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.510214] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.510349] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.510479] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.510805] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.510996] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.511212] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.511595] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.511860] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3e109fe-6c2f-407e-97fd-39b74b3bc4bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.796533] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 986.796926] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.855374] env[62909]: INFO networking_nsxv3.common.synchronization [req-9784f911-c51b-4f84-9e79-5183adaa9275 req-d4c9948a-5019-4388-b3ed-4fac8347144c tempest-ListImageFiltersTestJSON-1708948366 tempest-ListImageFiltersTestJSON-1708948366-project-member] Enqueued Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 986.858442] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGHEST for action security_group_members [ 986.858442] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.858442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.858442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.858442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.858442] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.858442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.858442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.858442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.858442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.858442] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.015144] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.015144] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.015144] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.015144] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.015144] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.015506] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port b3e109fe-6c2f-407e-97fd-39b74b3bc4bc not found, creating... [ 987.015790] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.015955] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.016153] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.016743] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.016743] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.017669] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.017767] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.017822] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.018114] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.018332] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.018515] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: b3e109fe-6c2f-407e-97fd-39b74b3bc4bc is going to be created. [ 987.046512] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.046852] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.046941] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.047293] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.047568] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.047825] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.361430] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.361870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.361870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.361947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.389761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.390815] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.390815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.390815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.390815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.390815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.390815] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb is going to be updated. [ 987.428839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.429091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.429091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.429301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.429449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.439750] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: IN_PROGRESS for 2s [ 988.099198] env[62909]: INFO networking_nsxv3.common.synchronization [req-d3a86758-c552-45c2-9147-add321dea221 req-cb3e657f-5f20-4549-b203-b38a86f2b7c7 service nova] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_rules [ 988.099405] env[62909]: INFO networking_nsxv3.common.synchronization [req-d3a86758-c552-45c2-9147-add321dea221 req-cb3e657f-5f20-4549-b203-b38a86f2b7c7 service nova] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 988.099551] env[62909]: INFO networking_nsxv3.common.synchronization [req-d3a86758-c552-45c2-9147-add321dea221 req-cb3e657f-5f20-4549-b203-b38a86f2b7c7 service nova] Enqueued Resource ID: b3e109fe-6c2f-407e-97fd-39b74b3bc4bc with Priority: HIGHEST for action port [ 988.099815] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_rules [ 988.099957] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 988.100078] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e109fe-6c2f-407e-97fd-39b74b3bc4bc with Priority: HIGHEST for action port [ 988.100689] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.100834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.100899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.101588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.101658] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.102604] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.102745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.102816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.103031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.103204] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.103305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.103393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.106235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.106235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.106235] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.110043] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.110480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.110480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.110681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.110796] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3e109fe-6c2f-407e-97fd-39b74b3bc4bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.614493] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.615300] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3e109fe-6c2f-407e-97fd-39b74b3bc4bc with status ACTIVE [ 988.615511] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.615625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.615697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.618756] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.618756] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.618756] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3e109fe-6c2f-407e-97fd-39b74b3bc4bc is going to be updated. [ 988.618756] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.618756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.643122] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.643122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.643122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.644048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.644048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.644048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.119813] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.450401] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb in Status: SUCCESS [ 989.450569] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb deletion is rescheduled due to dependency. [ 989.450709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.622720] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.623231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.623231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.623362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.623435] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.623604] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 989.654467] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.654669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.654669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.654873] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.655033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.664115] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 990.971888] env[62909]: INFO networking_nsxv3.common.synchronization [req-079021ab-1ee3-42e5-807d-ce91e16a4550 req-952abab3-98f8-44b3-9ecf-1985bb3579aa tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_members [ 990.972796] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_members [ 990.978904] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e666168c-26eb-4fba-8f02-30bb3eb590d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.978904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.978904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.978904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.978904] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.978904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.978904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.978904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.978904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.978904] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.379415] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.379415] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.379415] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.379415] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.379415] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.379415] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.379415] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.379839] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.380252] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.380549] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.380724] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.381535] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.381778] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.382366] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.382366] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.382572] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.411360] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.411575] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 991.412154] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.412154] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.412347] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-91711c66-4bec-40d9-b1be-9603bbad7e46 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.412579] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-91711c66-4bec-40d9-b1be-9603bbad7e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.412709] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-91711c66-4bec-40d9-b1be-9603bbad7e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.414164] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-91711c66-4bec-40d9-b1be-9603bbad7e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.416178] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91711c66-4bec-40d9-b1be-9603bbad7e46',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.485300] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.486792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.486888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.487150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.487249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.487485] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.487600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.487656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.487815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.487892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.487974] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 already deleted. [ 991.488068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.676016] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 991.676016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.676245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.676306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.676519] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.676660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.676726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.676897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.676980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.677077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.677266] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.919390] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.919708] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.919854] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.920321] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.920530] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.920748] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 91711c66-4bec-40d9-b1be-9603bbad7e46 not found, creating... [ 991.921645] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.921817] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.921951] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.922259] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.922421] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.922775] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.922946] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.923100] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.923391] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.923596] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.923790] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 91711c66-4bec-40d9-b1be-9603bbad7e46 is going to be created. [ 991.961783] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.962018] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.962275] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.962471] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.963161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.963161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-91711c66-4bec-40d9-b1be-9603bbad7e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.179868] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.180418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.180418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.180418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.181116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.181376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.181449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.181635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.181725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.181821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.181988] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.182105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.182165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.182310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.182496] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.182614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.182714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.182805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.182882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.182959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.183065] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.686120] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e66bfb9-974f-43a6-93f8-54f17b7d81b3: rpc.has_security_group_logging(os_id): False [ 992.709103] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.709331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.709395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.709684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.709794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.710178] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.710178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.710339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.710514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.710607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.710855] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.710940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.711161] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.711492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.711585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.711987] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.712116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.712212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.712770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.712862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.712986] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 992.754271] env[62909]: INFO networking_nsxv3.common.synchronization [req-079021ab-1ee3-42e5-807d-ce91e16a4550 req-84d2dfae-a7e3-49f1-913c-ecffe9188703 service nova] Enqueued Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_rules [ 992.754271] env[62909]: INFO networking_nsxv3.common.synchronization [req-079021ab-1ee3-42e5-807d-ce91e16a4550 req-84d2dfae-a7e3-49f1-913c-ecffe9188703 service nova] Enqueued Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_members [ 992.754470] env[62909]: INFO networking_nsxv3.common.synchronization [req-079021ab-1ee3-42e5-807d-ce91e16a4550 req-84d2dfae-a7e3-49f1-913c-ecffe9188703 service nova] Enqueued Resource ID: 91711c66-4bec-40d9-b1be-9603bbad7e46 with Priority: HIGHEST for action port [ 992.756259] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_rules [ 992.756517] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_members [ 992.756692] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91711c66-4bec-40d9-b1be-9603bbad7e46 with Priority: HIGHEST for action port [ 992.757224] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e666168c-26eb-4fba-8f02-30bb3eb590d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.757791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.758302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.758302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.758590] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.759770] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e666168c-26eb-4fba-8f02-30bb3eb590d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.760385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.760385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.760647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.760931] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.761079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.761263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.761567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.761703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.761934] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.764155] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-91711c66-4bec-40d9-b1be-9603bbad7e46 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.764393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91711c66-4bec-40d9-b1be-9603bbad7e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.764452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91711c66-4bec-40d9-b1be-9603bbad7e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.765906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91711c66-4bec-40d9-b1be-9603bbad7e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.765906] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91711c66-4bec-40d9-b1be-9603bbad7e46',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.813211] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.813469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.813469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.813785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.813963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.835414] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 993.266613] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.267984] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e666168c-26eb-4fba-8f02-30bb3eb590d8 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.267984] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.268611] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91711c66-4bec-40d9-b1be-9603bbad7e46 with status ACTIVE [ 993.268611] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.268821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.268821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.269268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.269438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.272545] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.272545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.272545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.272545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.272545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.272545] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.272545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.272545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.272545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.272545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.272545] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91711c66-4bec-40d9-b1be-9603bbad7e46 is going to be updated. [ 993.303257] env[62909]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] NSXv3 Agent Agent loop - iteration:1 completed [ 993.304064] env[62909]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] NSXv3 Agent Agent loop - iteration:2 started [ 993.312186] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.312712] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.312712] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.313325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.313414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.313684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91711c66-4bec-40d9-b1be-9603bbad7e46" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.608892] env[62909]: INFO networking_nsxv3.common.synchronization [req-2a8468f9-ac51-416c-82a3-88a7ab1094ec req-efaab44e-fc8e-45d3-97fc-a85131c02a13 tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 993.609376] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 993.609685] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.609810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.609880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.610088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.610245] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.610340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.610421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.610601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.611540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.611540] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.770288] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.113959] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.114145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.114253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.114556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.114666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.114959] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.115046] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.115082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.115231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.115302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.115386] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 994.149580] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.149786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.149786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.149988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.150157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.164098] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 994.252963] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.253172] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.253314] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.254078] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.254078] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.254182] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.254214] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.258023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.258023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.258023] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.258023] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.258023] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.258023] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.258023] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.258023] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.258023] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.272938] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.273300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.273300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.273408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.273833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.273833] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 is going to be created. [ 994.296513] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.296685] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.296835] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.297141] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.297407] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-c64b5774-e946-4217-a170-f93b64d5070b taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.297597] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-c64b5774-e946-4217-a170-f93b64d5070b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.297740] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-c64b5774-e946-4217-a170-f93b64d5070b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.298127] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-c64b5774-e946-4217-a170-f93b64d5070b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.298301] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c64b5774-e946-4217-a170-f93b64d5070b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.316058] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.316219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.316219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.316480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.316585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.328795] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 in Status: UNINITIALIZED for 2s [ 994.801430] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.801778] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.801942] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.802293] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.802491] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.802737] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port c64b5774-e946-4217-a170-f93b64d5070b not found, creating... [ 994.803073] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.803673] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.803754] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.804029] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.804181] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.804553] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.805448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.805448] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.805573] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.805747] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.805920] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: c64b5774-e946-4217-a170-f93b64d5070b is going to be created. [ 994.831349] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.831612] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.831792] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.832198] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.832586] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.832915] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-c64b5774-e946-4217-a170-f93b64d5070b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.848587] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 994.849693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.369331] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e05319a9-c2cd-4ad0-8924-fbb6efb90f9d None None] Enqueued Resource ID: 6a14bde8-e0ef-405e-830f-b59a3be1c3aa with Priority: HIGHEST for action port [ 995.369331] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a14bde8-e0ef-405e-830f-b59a3be1c3aa with Priority: HIGHEST for action port [ 995.369805] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a14bde8-e0ef-405e-830f-b59a3be1c3aa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.370052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a14bde8-e0ef-405e-830f-b59a3be1c3aa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.370052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a14bde8-e0ef-405e-830f-b59a3be1c3aa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.372967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a14bde8-e0ef-405e-830f-b59a3be1c3aa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.373332] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a14bde8-e0ef-405e-830f-b59a3be1c3aa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.787315] env[62909]: INFO networking_nsxv3.common.synchronization [req-2a8468f9-ac51-416c-82a3-88a7ab1094ec req-b99ff2d2-fb0c-4574-afef-e7b4246134b0 service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 995.787315] env[62909]: INFO networking_nsxv3.common.synchronization [req-2a8468f9-ac51-416c-82a3-88a7ab1094ec req-b99ff2d2-fb0c-4574-afef-e7b4246134b0 service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 995.787315] env[62909]: INFO networking_nsxv3.common.synchronization [req-2a8468f9-ac51-416c-82a3-88a7ab1094ec req-b99ff2d2-fb0c-4574-afef-e7b4246134b0 service nova] Enqueued Resource ID: c64b5774-e946-4217-a170-f93b64d5070b with Priority: HIGHEST for action port [ 995.787551] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 995.787589] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 995.787763] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c64b5774-e946-4217-a170-f93b64d5070b with Priority: HIGHEST for action port [ 995.788471] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.788615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.788679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.788885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.788988] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.789902] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.789996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.790237] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-c64b5774-e946-4217-a170-f93b64d5070b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.790343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c64b5774-e946-4217-a170-f93b64d5070b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.790406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c64b5774-e946-4217-a170-f93b64d5070b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.790609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c64b5774-e946-4217-a170-f93b64d5070b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.790680] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c64b5774-e946-4217-a170-f93b64d5070b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.879468] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a14bde8-e0ef-405e-830f-b59a3be1c3aa [ 995.879724] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.879927] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.880031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.880747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.880747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.880747] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a14bde8-e0ef-405e-830f-b59a3be1c3aa already deleted. [ 995.880747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a14bde8-e0ef-405e-830f-b59a3be1c3aa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.179279] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 996.179642] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 996.179642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.179931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.179931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.180269] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.180269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.180269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.180499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.180499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.180599] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.230323] env[62909]: INFO networking_nsxv3.common.synchronization [req-cac69c14-cd3f-4341-b093-b2217a88118c req-36b430da-c8b5-4cd1-85a8-01d2d70bc541 tempest-ImagesTestJSON-652168268 tempest-ImagesTestJSON-652168268-project-member] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 996.233636] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 996.233636] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.233636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.233636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.233636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.233636] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.233968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.233968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.235113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.235113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.235113] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.293973] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.296180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.296180] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c64b5774-e946-4217-a170-f93b64d5070b with status ACTIVE [ 996.296180] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.296180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.296180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.296614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.296614] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.296717] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.296825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.296894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.297213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.297308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.297635] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.297907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.297953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.298189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.298420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.299573] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c64b5774-e946-4217-a170-f93b64d5070b is going to be updated. [ 996.351499] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 in Status: SUCCESS [ 996.352263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.352263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.352263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.352497] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.352497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.352497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.352628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.353182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.353182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.353182] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.361898] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.362129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.362129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.362329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.362597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.362689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c64b5774-e946-4217-a170-f93b64d5070b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.651781] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.651781] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.651781] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.651781] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.652787] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.652861] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.652988] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.653348] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.653498] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.653709] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.653823] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.653933] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.654145] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.654218] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.654285] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.654418] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.684653] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.686641] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.686816] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 996.686959] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.687161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-284" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.687480] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-1559da30-bfec-4f82-9d1e-605294200ff3 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.687657] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-1559da30-bfec-4f82-9d1e-605294200ff3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.687777] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-1559da30-bfec-4f82-9d1e-605294200ff3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.688831] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-1559da30-bfec-4f82-9d1e-605294200ff3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.688953] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1559da30-bfec-4f82-9d1e-605294200ff3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.736967] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.737251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.737251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.737458] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.737550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.737929] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.737929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.738151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.738361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.738361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.738563] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 996.802250] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.802408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.802524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.802666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.802809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.814990] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 996.857599] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.191150] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.192491] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.192701] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.192840] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.193134] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.193288] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.193448] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 1559da30-bfec-4f82-9d1e-605294200ff3 not found, creating... [ 997.193707] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.193866] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.193988] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.194275] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.194350] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.194634] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.194792] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.194911] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.195132] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.195269] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.195411] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 1559da30-bfec-4f82-9d1e-605294200ff3 is going to be created. [ 997.221141] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.221141] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.221141] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.221141] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.221141] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.221392] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-1559da30-bfec-4f82-9d1e-605294200ff3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.358036] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e666168c-26eb-4fba-8f02-30bb3eb590d8: rpc.has_security_group_logging(os_id): False [ 997.379976] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.380178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.380319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.380497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.380497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.380734] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.381299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.381299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.381299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.381299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.381299] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 is going to be created. [ 997.490235] env[62909]: INFO networking_nsxv3.common.synchronization [req-f7d1b0e7-ebfb-47b1-ab6b-030e4a26f639 req-823ab1a8-522a-4a60-b180-16de8a6f34f0 tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 997.490235] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 997.490235] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.490235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.490235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.490235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.493251] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.493251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.493251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.493251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.493251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.493251] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.522189] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.522189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.522189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.522189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.522189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.540223] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 in Status: IN_PROGRESS for 2s [ 997.697987] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.698401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.698401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.698560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.698697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.698873] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 997.764508] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.764508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.764508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.764820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.765552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.781678] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 997.995688] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.998043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.998043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.998043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.998043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.998043] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.998043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.998043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.998043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.998043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.998043] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 is going to be updated. [ 998.036061] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.036255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.036344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.036575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.036758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.056131] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: IN_PROGRESS for 2s [ 998.056131] env[62909]: INFO networking_nsxv3.common.synchronization [req-cac69c14-cd3f-4341-b093-b2217a88118c req-df86493a-c169-4913-aa27-1fff976b4805 service nova] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_rules [ 998.056131] env[62909]: INFO networking_nsxv3.common.synchronization [req-cac69c14-cd3f-4341-b093-b2217a88118c req-df86493a-c169-4913-aa27-1fff976b4805 service nova] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 998.056131] env[62909]: INFO networking_nsxv3.common.synchronization [req-cac69c14-cd3f-4341-b093-b2217a88118c req-df86493a-c169-4913-aa27-1fff976b4805 service nova] Enqueued Resource ID: 1559da30-bfec-4f82-9d1e-605294200ff3 with Priority: HIGHEST for action port [ 998.056939] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_rules [ 998.056939] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 998.056939] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1559da30-bfec-4f82-9d1e-605294200ff3 with Priority: HIGHEST for action port [ 998.057090] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.057275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.057348] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.057731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.057855] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.059278] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.063027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.063027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-1559da30-bfec-4f82-9d1e-605294200ff3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.063027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1559da30-bfec-4f82-9d1e-605294200ff3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.063027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1559da30-bfec-4f82-9d1e-605294200ff3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.063027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1559da30-bfec-4f82-9d1e-605294200ff3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.063027] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1559da30-bfec-4f82-9d1e-605294200ff3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.312782] env[62909]: INFO networking_nsxv3.common.synchronization [None req-cbed5063-4e47-4882-ad51-0385c06fcd97 None None] Enqueued Resource ID: 5a70b29a-bb75-433f-a47e-37b5f793af4e with Priority: HIGHEST for action port [ 998.313437] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a70b29a-bb75-433f-a47e-37b5f793af4e with Priority: HIGHEST for action port [ 998.313789] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a70b29a-bb75-433f-a47e-37b5f793af4e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.313987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a70b29a-bb75-433f-a47e-37b5f793af4e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.313987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a70b29a-bb75-433f-a47e-37b5f793af4e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.315365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a70b29a-bb75-433f-a47e-37b5f793af4e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.316751] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a70b29a-bb75-433f-a47e-37b5f793af4e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.562620] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.562761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.563269] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1559da30-bfec-4f82-9d1e-605294200ff3 with status ACTIVE [ 998.563269] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.563269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.563269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.563472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.563564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.563739] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.563832] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.563905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.564095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.564158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.564305] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.564720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.564720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.564720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.564720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.564720] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1559da30-bfec-4f82-9d1e-605294200ff3 is going to be updated. [ 998.593686] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.593932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.594040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.594372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.594443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.594597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1559da30-bfec-4f82-9d1e-605294200ff3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.818605] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a70b29a-bb75-433f-a47e-37b5f793af4e [ 998.818605] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.818978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.818978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.818978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.819083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.819211] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a70b29a-bb75-433f-a47e-37b5f793af4e already deleted. [ 998.819309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a70b29a-bb75-433f-a47e-37b5f793af4e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.829741] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 998.829741] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa deletion is rescheduled due to dependency. [ 998.829741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.829741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.830049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.830098] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.830217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.830296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.830545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.830622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.832145] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.157336] env[62909]: INFO networking_nsxv3.common.synchronization [req-76c8d719-e253-4134-9a91-92c8ee88fab0 req-3c961693-17d7-4f92-aedc-6086bb9c26df tempest-ServersAdminTestJSON-1709758822 tempest-ServersAdminTestJSON-1709758822-project-member] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 999.157336] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 999.157444] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.158029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.158029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.158029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.158029] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.158292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.158292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.158470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.158581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.158697] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.335411] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.552245] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 in Status: SUCCESS [ 999.552514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.660680] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.794837] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 999.794989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.795166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.795379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.795572] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.795690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.795755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.795899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.795975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.796072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.796174] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.838908] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.062249] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: SUCCESS [ 1000.062445] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 deletion is rescheduled due to dependency. [ 1000.062497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.165023] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.298938] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.298938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.298938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.298938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.299360] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.299360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.299360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.299360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.299537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.299537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.299739] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.299837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.299919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.300079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.300255] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.300363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.300426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.300605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.300731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.300801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.300886] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.343360] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.343647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.343731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.343975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.344132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.344275] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 1000.378679] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.378838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.378930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.379228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.379417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.391948] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 1000.665341] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.665930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.665930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.665930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.666136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.666136] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 1000.736721] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.736721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.736721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.737181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.737229] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.761650] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 1000.804174] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00039edf-d86f-462e-a706-bad2d411b887: rpc.has_security_group_logging(os_id): False [ 1000.834093] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.834333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.834333] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.834661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.834886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.835263] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.835443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.835534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.835761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.835860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.836261] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.836471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.836575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.836781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.836905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.837251] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.837388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.837466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.837696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.837833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.837833] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1000.934875] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.935292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.935292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.935387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.935518] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.953421] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1002.402762] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 1002.403176] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.403176] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.403385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.403573] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.403690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.403758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.403915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.403992] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.404090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.404205] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.796011] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 1002.796321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.906345] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.906568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.906619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.906803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.906972] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.907084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.907336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.907336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.907405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.907448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.907721] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.907721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.907807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.907903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.908057] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.908152] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.908212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.908348] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.908423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.908505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.908600] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.967855] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1002.968108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.411462] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 828a3fee-5001-4141-bcfb-64c185ab0efa: rpc.has_security_group_logging(os_id): False [ 1003.434510] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.434640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1003.434704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.434885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.434978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.435210] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.435459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1003.435459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.435572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.435609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.435911] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.436019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1003.436078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.436219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.436286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.436480] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.436577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1003.436635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.436804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.436892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.436980] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 1003.512337] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.512858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1003.512858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.513195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.513311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.548736] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 1004.158145] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1004.158145] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1005.565959] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 1005.565959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.202198] env[62909]: INFO networking_nsxv3.common.synchronization [req-66901d23-9337-47e8-975a-eec7610bd314 req-7fa39eaf-6d3a-4eb5-bc04-5531deab2769 tempest-ImagesOneServerNegativeTestJSON-373251561 tempest-ImagesOneServerNegativeTestJSON-373251561-project-member] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1007.203969] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1007.204530] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.205025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.205025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.205223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.206888] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.206888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.206888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.206888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.206888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.206888] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.710607] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.710782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.710855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.711103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.711198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.711651] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.711651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.711651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.711869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.711869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.711978] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be updated. [ 1007.765164] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.765312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.765381] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.765595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.765840] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.787130] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: IN_PROGRESS for 2s [ 1009.296166] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.296462] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.296658] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.296998] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.297384] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.297618] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.297802] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.298135] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.298388] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.299028] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.299028] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.299028] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.299239] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.299412] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.299580] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.299788] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.323714] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.323860] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1009.324582] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.324582] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-126" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.324723] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.324800] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.324936] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.325555] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.325555] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3e109fe-6c2f-407e-97fd-39b74b3bc4bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.797566] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: SUCCESS [ 1009.797566] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc deletion is rescheduled due to dependency. [ 1009.797811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.828117] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.828420] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.828566] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.828908] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.829121] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.829509] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.829696] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.829823] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.830075] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.830229] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.830541] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.830708] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.830841] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.831081] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.831298] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.831422] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: b3e109fe-6c2f-407e-97fd-39b74b3bc4bc is going to be updated. [ 1009.856140] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.856494] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.856720] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.857015] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.857373] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.857752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.576330] env[62909]: INFO networking_nsxv3.common.synchronization [req-2315b673-bf86-4322-a677-74ad062435e5 req-59f8a78d-3ba1-4a0b-a53e-29c5be691a2e service nova] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_rules [ 1010.576330] env[62909]: INFO networking_nsxv3.common.synchronization [req-2315b673-bf86-4322-a677-74ad062435e5 req-59f8a78d-3ba1-4a0b-a53e-29c5be691a2e service nova] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 1010.576889] env[62909]: INFO networking_nsxv3.common.synchronization [req-2315b673-bf86-4322-a677-74ad062435e5 req-59f8a78d-3ba1-4a0b-a53e-29c5be691a2e service nova] Enqueued Resource ID: b3e109fe-6c2f-407e-97fd-39b74b3bc4bc with Priority: HIGHEST for action port [ 1010.576889] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_rules [ 1010.576889] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 1010.576889] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e109fe-6c2f-407e-97fd-39b74b3bc4bc with Priority: HIGHEST for action port [ 1010.577724] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.577856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.577922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.578155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.578246] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.580127] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.580127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.580361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.580520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.580678] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.580780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.580843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.580995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.581161] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.581330] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.583046] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.583169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.583653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.583653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.583653] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3e109fe-6c2f-407e-97fd-39b74b3bc4bc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.083251] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.084895] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.084895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.085146] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3e109fe-6c2f-407e-97fd-39b74b3bc4bc with status ACTIVE [ 1011.085414] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.085559] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.085631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.085825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.085913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.086160] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.086336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.086418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.086592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.086669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.086856] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.086954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.087044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.087270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.087374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.087466] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3e109fe-6c2f-407e-97fd-39b74b3bc4bc is going to be updated. [ 1011.112779] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.112986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.113063] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.113283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.113478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.113685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3e109fe-6c2f-407e-97fd-39b74b3bc4bc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.587790] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.091861] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.092086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.092086] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.093017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.093017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.093017] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 1012.127325] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.127560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.127560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.127747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.127910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.140923] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 1014.152541] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 1014.152802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.152950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.153177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.153376] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.153506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.153572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.153750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.153831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.153915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.154009] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.657014] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.657014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.657014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.657014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.657014] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.657014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.657014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.657403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.657403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.657403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.657529] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.657529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.657644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.658665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.658665] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.658665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.658665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.658665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.658665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.658665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.658665] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.990901] env[62909]: INFO networking_nsxv3.common.synchronization [req-7be5b1b7-2e99-4eca-8f74-16582213ea1e req-ab73581c-702a-4014-8fcf-b705f6e3d383 tempest-ServerRescueNegativeTestJSON-298244947 tempest-ServerRescueNegativeTestJSON-298244947-project-member] Enqueued Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1014.990901] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1014.991993] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.991993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.991993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.991993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.991993] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.991993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.991993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.992794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.992794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.992794] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.160929] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e66bfb9-974f-43a6-93f8-54f17b7d81b3: rpc.has_security_group_logging(os_id): False [ 1015.178729] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.178890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.178948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.179149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.179255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.179482] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.179584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.179633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.179786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.179860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.180056] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.180143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.180195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.180335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.180560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.180623] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.180699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.180699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.180860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.180920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.180970] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be updated. [ 1015.246237] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.246466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.246598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.246925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.247174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.264791] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: IN_PROGRESS for 2s [ 1015.327401] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.327580] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.327711] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.328054] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.328338] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.328574] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.328698] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.328919] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.329076] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.329397] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.329541] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.329657] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.329768] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.329884] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.330047] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.330143] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.371913] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.371913] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1015.371913] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.371913] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.371913] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-f752f060-cdfa-4b16-904d-9263dfa26442 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.371913] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-f752f060-cdfa-4b16-904d-9263dfa26442" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.371913] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-f752f060-cdfa-4b16-904d-9263dfa26442" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.371913] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-f752f060-cdfa-4b16-904d-9263dfa26442" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.371913] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f752f060-cdfa-4b16-904d-9263dfa26442',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.495316] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.495316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.495316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.495649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.495691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.495871] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.495969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.496037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.496198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.496278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.496388] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada642ef-0700-436a-87e6-5df9c7267f20 already deleted. [ 1015.496443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.875488] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.875717] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.875767] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.876090] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.876286] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.876445] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port f752f060-cdfa-4b16-904d-9263dfa26442 not found, creating... [ 1015.876732] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.876952] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.877031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.877253] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.877390] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.877675] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.877870] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.877941] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.878175] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.878401] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.878764] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: f752f060-cdfa-4b16-904d-9263dfa26442 is going to be created. [ 1015.901809] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.902056] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.902191] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.902498] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.902741] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.902974] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-f752f060-cdfa-4b16-904d-9263dfa26442" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.199149] env[62909]: INFO networking_nsxv3.common.synchronization [None req-9d55a2b8-7762-43f6-8754-ef22176af5e9 tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_rules [ 1016.199149] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_rules [ 1016.199149] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.199149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.199149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.200211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.200367] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a69ff3e-5b01-4156-a417-d9c5f614e7e4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.287239] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ca727074-6195-4f3b-a598-3bc7ea023cfa tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_rules [ 1016.288026] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_rules [ 1016.288363] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.288467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.731010] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.731010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.731010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.731010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.731010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.731010] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 already deleted. [ 1016.731010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.731010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.731010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.731010] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a69ff3e-5b01-4156-a417-d9c5f614e7e4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.165744] env[62909]: INFO networking_nsxv3.common.synchronization [req-7be5b1b7-2e99-4eca-8f74-16582213ea1e req-d493a747-b881-42b7-82d9-87f87bbc76f2 service nova] Enqueued Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_rules [ 1017.166304] env[62909]: INFO networking_nsxv3.common.synchronization [req-7be5b1b7-2e99-4eca-8f74-16582213ea1e req-d493a747-b881-42b7-82d9-87f87bbc76f2 service nova] Enqueued Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1017.166304] env[62909]: INFO networking_nsxv3.common.synchronization [req-7be5b1b7-2e99-4eca-8f74-16582213ea1e req-d493a747-b881-42b7-82d9-87f87bbc76f2 service nova] Enqueued Resource ID: f752f060-cdfa-4b16-904d-9263dfa26442 with Priority: HIGHEST for action port [ 1017.166304] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_rules [ 1017.166612] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1017.166612] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f752f060-cdfa-4b16-904d-9263dfa26442 with Priority: HIGHEST for action port [ 1017.166995] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.169324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.169420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.169789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.169872] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.170717] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.170832] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.170896] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.171074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.171214] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.171303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.171379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.171522] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.174847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.174847] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.174847] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-f752f060-cdfa-4b16-904d-9263dfa26442 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.174847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f752f060-cdfa-4b16-904d-9263dfa26442" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.174847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f752f060-cdfa-4b16-904d-9263dfa26442" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.174847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f752f060-cdfa-4b16-904d-9263dfa26442" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.174847] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f752f060-cdfa-4b16-904d-9263dfa26442',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.255800] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.255800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.255800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.255800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.255800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.255800] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 already deleted. [ 1017.256662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.277823] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 in Status: SUCCESS [ 1017.278204] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.675065] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.675259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.675432] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.676552] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f752f060-cdfa-4b16-904d-9263dfa26442 with status ACTIVE [ 1017.676671] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.676739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.676854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.677011] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.677151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.677336] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.677434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.677494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.677675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.677754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.677954] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.678320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.678408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.678558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.678635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.678720] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f752f060-cdfa-4b16-904d-9263dfa26442 is going to be updated. [ 1017.720205] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.722021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.722021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.722021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.722021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.722021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f752f060-cdfa-4b16-904d-9263dfa26442" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.786051] env[62909]: INFO networking_nsxv3.common.synchronization [req-5e8e4dc4-0203-47bd-a9cb-27eaa881ba9e req-e7f74263-7298-4bb5-a497-b6ec4c0abadf tempest-ServerRescueNegativeTestJSON-298244947 tempest-ServerRescueNegativeTestJSON-298244947-project-member] Enqueued Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1017.786730] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1017.787904] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.788973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.183275] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.563664] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.564049] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.564140] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.564370] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.564666] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.564868] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.565202] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.565460] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.565628] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.565877] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.566016] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.566132] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.566315] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.566391] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.566462] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.566601] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.586177] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.586439] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.586694] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.586822] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.587279] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-bd8a334c-ccd2-4d47-8194-494527e06ae9 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.587522] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-bd8a334c-ccd2-4d47-8194-494527e06ae9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.587700] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-bd8a334c-ccd2-4d47-8194-494527e06ae9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.588041] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-bd8a334c-ccd2-4d47-8194-494527e06ae9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.588190] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd8a334c-ccd2-4d47-8194-494527e06ae9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.685540] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.685724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.685800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.686030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.686123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.686242] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada642ef-0700-436a-87e6-5df9c7267f20 is going to be created. [ 1018.716102] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.716330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.716415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.716700] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.716972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.731310] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: UNINITIALIZED for 2s [ 1019.090931] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.091259] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.091515] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.091850] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.092033] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.092270] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port bd8a334c-ccd2-4d47-8194-494527e06ae9 not found, creating... [ 1019.092920] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.093173] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.093348] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.093739] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.093933] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.094319] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.094579] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.094750] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.095049] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.095237] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.095416] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: bd8a334c-ccd2-4d47-8194-494527e06ae9 is going to be created. [ 1019.121722] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.121722] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.122015] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.122292] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.122504] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.123115] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-bd8a334c-ccd2-4d47-8194-494527e06ae9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.153509] env[62909]: INFO networking_nsxv3.common.synchronization [req-5e8e4dc4-0203-47bd-a9cb-27eaa881ba9e req-6c8c2805-7a19-49c0-8cc0-7f95a838d7ce service nova] Enqueued Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_rules [ 1020.153988] env[62909]: INFO networking_nsxv3.common.synchronization [req-5e8e4dc4-0203-47bd-a9cb-27eaa881ba9e req-6c8c2805-7a19-49c0-8cc0-7f95a838d7ce service nova] Enqueued Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1020.153988] env[62909]: INFO networking_nsxv3.common.synchronization [req-5e8e4dc4-0203-47bd-a9cb-27eaa881ba9e req-6c8c2805-7a19-49c0-8cc0-7f95a838d7ce service nova] Enqueued Resource ID: bd8a334c-ccd2-4d47-8194-494527e06ae9 with Priority: HIGHEST for action port [ 1020.154434] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_rules [ 1020.154571] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1020.154668] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd8a334c-ccd2-4d47-8194-494527e06ae9 with Priority: HIGHEST for action port [ 1020.154949] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.157175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.157465] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.157568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.157888] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd8a334c-ccd2-4d47-8194-494527e06ae9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.157888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd8a334c-ccd2-4d47-8194-494527e06ae9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.158040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd8a334c-ccd2-4d47-8194-494527e06ae9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.158163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd8a334c-ccd2-4d47-8194-494527e06ae9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.158234] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd8a334c-ccd2-4d47-8194-494527e06ae9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.662231] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd8a334c-ccd2-4d47-8194-494527e06ae9 with status ACTIVE [ 1020.662231] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.662231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.662231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.663924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.663924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.663924] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.663924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.663924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.663924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.663924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.664300] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.664524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.664631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.664865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.664981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.665133] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd8a334c-ccd2-4d47-8194-494527e06ae9 is going to be updated. [ 1020.706541] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.706767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.706816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.707278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.707399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.707656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd8a334c-ccd2-4d47-8194-494527e06ae9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.743661] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: SUCCESS [ 1020.743925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.744836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.744836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.744836] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.744836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.744836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.745169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.745169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.745169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.745294] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.746795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.746906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.747217] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.747437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.747540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.747813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.747964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.748136] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.254028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.254028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.254028] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.283000] env[62909]: INFO networking_nsxv3.common.synchronization [req-a49a008b-1852-46d5-a2a0-3e7336c3cd60 req-5d9ebc15-c80e-4041-80b9-f0b5a5fe1498 tempest-ServersAdminTestJSON-1709758822 tempest-ServersAdminTestJSON-1709758822-project-member] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 1021.283542] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 1021.283947] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.284067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.284116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.284331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.284704] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.284818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.284874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.285070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.285151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.285249] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.757715] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.787757] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.099157] env[62909]: INFO networking_nsxv3.common.synchronization [req-087ad19b-48e3-4dae-b120-5d2eb4137e11 req-b435c811-f848-4b8e-9054-018b9bd3e7da tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1022.099988] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1022.100463] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.101026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.101026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.101026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.101268] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.101423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.101625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.101924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.102093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.102336] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.262304] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.262659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.262659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.262849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.262902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.263072] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada642ef-0700-436a-87e6-5df9c7267f20 is going to be updated. [ 1022.290314] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.326251] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.326476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.326476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.326658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.326817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.343216] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: IN_PROGRESS for 2s [ 1022.494594] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.494808] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.494926] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.495256] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.495532] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.495710] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.495839] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.496113] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.496235] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.496457] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.496589] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.496702] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.496889] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.496973] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.497094] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.497292] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.519785] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.519973] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.520124] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.520301] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.520628] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-87adb6e9-f00f-4164-8903-0a82d32416ca taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.520828] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-87adb6e9-f00f-4164-8903-0a82d32416ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.520953] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-87adb6e9-f00f-4164-8903-0a82d32416ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.521306] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-87adb6e9-f00f-4164-8903-0a82d32416ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.521520] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87adb6e9-f00f-4164-8903-0a82d32416ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.604112] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.795050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.802040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.802040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.802040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.802040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.802040] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 1022.839476] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.839476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.839476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.839476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.839476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.849296] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 1023.024088] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.024372] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.024504] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.024826] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.024996] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.025177] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 87adb6e9-f00f-4164-8903-0a82d32416ca not found, creating... [ 1023.025494] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.025678] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.025885] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.026064] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.026217] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.026528] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.026771] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.026850] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.027033] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.027177] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.027322] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 87adb6e9-f00f-4164-8903-0a82d32416ca is going to be created. [ 1023.037815] env[62909]: INFO networking_nsxv3.common.synchronization [req-c701f95c-9bd0-453d-9f37-d67f108ad90f req-d60209b8-679a-4579-9251-b2ee62eea106 tempest-AttachVolumeShelveTestJSON-1170767985 tempest-AttachVolumeShelveTestJSON-1170767985-project-member] Enqueued Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_members [ 1023.038437] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGHEST for action security_group_members [ 1023.038752] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.038877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.038936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.041393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.041393] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.041393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.041393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.041393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.041393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.041393] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.049880] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.049997] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.050166] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.050454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.050712] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.050968] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-87adb6e9-f00f-4164-8903-0a82d32416ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.107207] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.453934] env[62909]: INFO networking_nsxv3.common.synchronization [req-6898848a-17f6-45a7-a811-53c4fdb4068d req-32f8aca5-d277-4a30-8272-14c83bae67b5 tempest-ImagesTestJSON-652168268 tempest-ImagesTestJSON-652168268-project-member] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 1023.456661] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGHEST for action security_group_members [ 1023.456661] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.456661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.456661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.457231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.457543] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.458264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.458781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.459400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.459762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.460098] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.547914] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.547914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.547914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.547914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.547914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.547914] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.547914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.547914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.547914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.547914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.547914] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d711f143-3c86-4518-9590-301f0739c6ea is going to be updated. [ 1023.587165] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.587165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.587165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.587165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.587165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.599732] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d711f143-3c86-4518-9590-301f0739c6ea in Status: IN_PROGRESS for 2s [ 1023.612716] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.612716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.612716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.612716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.612716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.612716] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1023.642653] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.642653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.642653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.642653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.642653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.653981] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1023.967025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.967025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.967025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.967025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.967025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.967025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.967025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.967025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.967025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.967025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.967025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be updated. [ 1023.999340] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.999470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.999546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.999766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.999904] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.016426] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: IN_PROGRESS for 2s [ 1024.203404] env[62909]: INFO networking_nsxv3.common.synchronization [req-087ad19b-48e3-4dae-b120-5d2eb4137e11 req-1438a328-ce17-4dda-a9bf-476d7dac514b service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 1024.203467] env[62909]: INFO networking_nsxv3.common.synchronization [req-087ad19b-48e3-4dae-b120-5d2eb4137e11 req-1438a328-ce17-4dda-a9bf-476d7dac514b service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1024.203612] env[62909]: INFO networking_nsxv3.common.synchronization [req-087ad19b-48e3-4dae-b120-5d2eb4137e11 req-1438a328-ce17-4dda-a9bf-476d7dac514b service nova] Enqueued Resource ID: 87adb6e9-f00f-4164-8903-0a82d32416ca with Priority: HIGHEST for action port [ 1024.204245] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 1024.204370] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1024.204527] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87adb6e9-f00f-4164-8903-0a82d32416ca with Priority: HIGHEST for action port [ 1024.204718] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.204841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.204905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.205306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.205407] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.206249] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.206339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.206535] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-87adb6e9-f00f-4164-8903-0a82d32416ca taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.206632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87adb6e9-f00f-4164-8903-0a82d32416ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.206689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87adb6e9-f00f-4164-8903-0a82d32416ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.206868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87adb6e9-f00f-4164-8903-0a82d32416ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.206938] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87adb6e9-f00f-4164-8903-0a82d32416ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.355697] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: SUCCESS [ 1024.355997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.356274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.356679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.356957] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.357160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.357263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.362008] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.362008] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.362008] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.710257] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.710674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.712835] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87adb6e9-f00f-4164-8903-0a82d32416ca with status ACTIVE [ 1024.713105] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.713395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.713493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.713754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.713891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.714211] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.714460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.714460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.714549] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.714584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.714812] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.714968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.714968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.715159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.715217] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.715323] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87adb6e9-f00f-4164-8903-0a82d32416ca is going to be updated. [ 1024.753307] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.753482] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.753612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.753885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.754158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.754349] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87adb6e9-f00f-4164-8903-0a82d32416ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.861887] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 1024.861887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.864525] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.201704] env[62909]: INFO networking_nsxv3.common.synchronization [None req-8f1629c1-3b1b-4373-9cff-41b61b5a1845 tempest-ImagesOneServerNegativeTestJSON-373251561 tempest-ImagesOneServerNegativeTestJSON-373251561-project-member] Enqueued Resource ID: b6ac861c-94f6-4c2b-b799-2041279a1906 with Priority: HIGHEST for action security_group_rules [ 1025.201704] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6ac861c-94f6-4c2b-b799-2041279a1906 with Priority: HIGHEST for action security_group_rules [ 1025.201704] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6ac861c-94f6-4c2b-b799-2041279a1906 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.201704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6ac861c-94f6-4c2b-b799-2041279a1906" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.201704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6ac861c-94f6-4c2b-b799-2041279a1906" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.201704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6ac861c-94f6-4c2b-b799-2041279a1906" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.201704] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6ac861c-94f6-4c2b-b799-2041279a1906',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.338349] env[62909]: INFO networking_nsxv3.common.synchronization [None req-847bbbc9-41c5-468b-8313-0e1ba11136ab tempest-ImagesOneServerNegativeTestJSON-373251561 tempest-ImagesOneServerNegativeTestJSON-373251561-project-member] Enqueued Resource ID: b6ac861c-94f6-4c2b-b799-2041279a1906 with Priority: HIGHEST for action security_group_rules [ 1025.338882] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6ac861c-94f6-4c2b-b799-2041279a1906 with Priority: HIGHEST for action security_group_rules [ 1025.339209] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6ac861c-94f6-4c2b-b799-2041279a1906 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.339328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6ac861c-94f6-4c2b-b799-2041279a1906" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.367151] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.613216] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d711f143-3c86-4518-9590-301f0739c6ea in Status: SUCCESS [ 1025.613216] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d711f143-3c86-4518-9590-301f0739c6ea deletion is rescheduled due to dependency. [ 1025.613409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.666038] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1025.666038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.666038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.666038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.666038] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.666346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.666346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.666346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.666450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.667591] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.717945] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.718340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.718378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.720836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.720836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.720836] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6ac861c-94f6-4c2b-b799-2041279a1906 already deleted. [ 1025.720836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6ac861c-94f6-4c2b-b799-2041279a1906" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.720836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6ac861c-94f6-4c2b-b799-2041279a1906" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.720836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6ac861c-94f6-4c2b-b799-2041279a1906" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.720836] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6ac861c-94f6-4c2b-b799-2041279a1906',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.872535] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.872727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.872827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.873768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.873867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.873981] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada642ef-0700-436a-87e6-5df9c7267f20 is going to be updated. [ 1025.912396] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.912585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.912636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.912820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.912979] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.924355] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: IN_PROGRESS for 2s [ 1026.027683] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 828a3fee-5001-4141-bcfb-64c185ab0efa in Status: SUCCESS [ 1026.027962] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa deletion is rescheduled due to dependency. [ 1026.028153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.171866] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.246097] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.246298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.246376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.246632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.246730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.246830] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6ac861c-94f6-4c2b-b799-2041279a1906 already deleted. [ 1026.246916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6ac861c-94f6-4c2b-b799-2041279a1906" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.674496] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.177483] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.177790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.178551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.178806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.178954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.179118] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1027.211963] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.211963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.211963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.211963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.211963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.226053] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1027.251746] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.251913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.251982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.252219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.252330] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.754851] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.820138] env[62909]: INFO networking_nsxv3.common.synchronization [req-b0a444e1-6761-4fe9-86e9-8619fbc36318 req-dff31ca8-0fb7-4a71-b941-26fa6ddda5d1 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 1027.822062] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 1027.822062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.822062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.822062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.822062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.822342] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.822342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.822414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.828064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.828064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.828064] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.938227] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: SUCCESS [ 1027.938446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.938620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.938843] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.939283] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.939283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.939283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.939510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.939510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.939718] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.939771] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.940105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.940105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.940105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.940246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.940296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.940346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.940691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.940691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.940691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.940691] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.257817] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.328980] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.443527] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ada642ef-0700-436a-87e6-5df9c7267f20: rpc.has_security_group_logging(os_id): False [ 1028.465889] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.466105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.466414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.466480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.466544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.466761] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.466863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.466927] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.467088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.467165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.467336] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.467429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.467491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.467627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.467698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.467900] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.467998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.468213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.468392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.468674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.468674] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ada642ef-0700-436a-87e6-5df9c7267f20 is going to be created. [ 1028.528366] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.528561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.528561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.528786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.528970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.540913] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: IN_PROGRESS for 2s [ 1028.760355] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1028.760503] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1028.832060] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.242606] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 4s [ 1029.333739] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.334154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.334154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.334263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.334355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.334460] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 is going to be updated. [ 1029.370929] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.371170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.371344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.371705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.371908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.383525] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: IN_PROGRESS for 2s [ 1029.675726] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.675726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.675726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.675726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.687687] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1029.688749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.690162] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1029.726895] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.727870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.727870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.728516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.744447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.745457] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1029.745457] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1029.745581] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1029.786481] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.786658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.786744] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.786988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.789026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.789839] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1029.811356] env[62909]: INFO networking_nsxv3.common.synchronization [req-562f8be8-0367-44cc-898e-d176a5444cb8 req-54f4c1e5-12c7-46e1-84e3-66f0dcc065ce tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_members [ 1029.812034] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_members [ 1029.812384] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.812608] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.812708] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.813223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.816225] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.816467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.816631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.816915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.817175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.817890] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a69ff3e-5b01-4156-a417-d9c5f614e7e4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.888696] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.888696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.888696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.888696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.889392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.889865] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1029.963367] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.963367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.963664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.963664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.963966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.967883] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1029.968164] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'70dd2e08-5d3c-47df-8c82-524cc320dde0', '34e0fe86-bdd4-47ec-be48-37e9cf6eaafb', '1d9e8226-da60-440e-9104-6faa87b1a100', 'aa5afa51-af91-4a18-91ea-ad8cbadae183', '7ef8091d-5beb-460c-8d49-21cf9cd46551', '6b692d00-090d-4fca-8b85-19b077d9435b', '23297eee-5815-4160-b6ed-90818fa0ab3a', 'bf1c820f-c032-491e-a171-042f82234545', '57568fd4-ee2b-43e3-a228-9a168490f0f5', 'e414027f-367d-4f4e-abad-e74bd2a6a762', '732ce2ac-f7fb-41f5-ac97-eceb113118d9', '1f6e0db7-41ba-43f5-b841-2551ea96a39f', 'd89bba3e-b2fe-4856-b21c-5154e1f55eb5', '040e2818-d72e-44b6-b9e0-bdcfefe4cbdc', '3015041e-e0eb-4083-abbf-3bfc49610323', '59435e15-2dcf-4317-816e-1fcd9a40b9fb', 'bef0125d-be94-4dc6-922c-269322ae2b97', 'e666168c-26eb-4fba-8f02-30bb3eb590d8', '7e66bfb9-974f-43a6-93f8-54f17b7d81b3', 'd711f143-3c86-4518-9590-301f0739c6ea', 'e7b8e547-f24c-4b71-8565-214f37cb5c01', '24030e1e-897b-4a91-9a5a-7c9e92186e4b', '828a3fee-5001-4141-bcfb-64c185ab0efa', 'b2821bc4-3047-4598-bd51-10cd2a5b1137', 'cdf04703-55f3-479f-bb4c-a69bd221f98f', '14d66eff-4d06-4f86-92c4-66d09f1004ca', '00039edf-d86f-462e-a706-bad2d411b887', 'f599ba98-bf73-4cc1-922f-b14d6ba06469', '9854b6b4-9fde-4807-83f9-b2838c42920a', '85d35f16-322f-4fce-8671-2c59aba9257f', '91426ce9-c57f-42ef-bcee-74c76f9876e0', 'f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7', 'f3c6858c-f90d-4b04-bbda-341ff7525e29', '037af277-a74d-482c-b3ec-c4b5f5f92980', '4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5', '7e0b230b-d7d3-4c40-9cdd-92be876b4a05', 'f28a45c0-8394-4cec-b3b7-949be46fb2dd', '11f84bbc-cc8c-4244-87ea-1493e7543f81', '009d27ce-c5b1-4df0-81b4-05b91e8ed19e', 'd09a74b6-7c94-44f4-afba-b179607452eb', 'ada642ef-0700-436a-87e6-5df9c7267f20', 'ba398af1-904a-41aa-b098-1f2b15a308ac'} {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1029.968164] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1029.991478] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.991685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.991730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.991932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.992031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.992145] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1029.992215] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1029.992286] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1030.056042] env[62909]: INFO networking_nsxv3.common.synchronization [None req-346582ac-4dc0-42b1-b008-5e8ff120dbe1 tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_rules [ 1030.056511] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_rules [ 1030.056823] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc95494-492e-4f83-a225-dc8ad461b515 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.056950] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.057144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.057434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.057521] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc95494-492e-4f83-a225-dc8ad461b515',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.084435] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.084643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.084643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.084866] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.085922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.086435] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1030.086521] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1030.086606] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1030.086673] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1030.086750] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1030.086824] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGH for action security_group_rules [ 1030.086905] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGH for action security_group_rules [ 1030.086974] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGH for action security_group_rules [ 1030.087051] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGH for action security_group_rules [ 1030.087117] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGH for action security_group_rules [ 1030.087180] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b692d00-090d-4fca-8b85-19b077d9435b with Priority: HIGH for action security_group_rules [ 1030.087240] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGH for action security_group_rules [ 1030.087302] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGH for action security_group_rules [ 1030.087363] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGH for action security_group_rules [ 1030.087477] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGH for action security_group_rules [ 1030.087477] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 with Priority: HIGH for action security_group_rules [ 1030.087661] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGH for action security_group_rules [ 1030.087661] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 with Priority: HIGH for action security_group_rules [ 1030.087661] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGH for action security_group_rules [ 1030.087768] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGH for action security_group_rules [ 1030.087768] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb with Priority: HIGH for action security_group_rules [ 1030.087824] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bef0125d-be94-4dc6-922c-269322ae2b97 with Priority: HIGH for action security_group_rules [ 1030.087855] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGH for action security_group_rules [ 1030.087920] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGH for action security_group_rules [ 1030.087976] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGH for action security_group_rules [ 1030.088304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.218303] env[62909]: INFO networking_nsxv3.common.synchronization [None req-1ef56ddd-7ba2-463d-bc78-baf2b3dee656 tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_rules [ 1030.218917] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_rules [ 1030.219085] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 with Priority: HIGH for action security_group_rules [ 1030.219503] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGH for action security_group_rules [ 1030.219503] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGH for action security_group_rules [ 1030.219503] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3015041e-e0eb-4083-abbf-3bfc49610323 with Priority: HIGH for action security_group_rules [ 1030.220009] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d711f143-3c86-4518-9590-301f0739c6ea with Priority: HIGH for action security_group_rules [ 1030.220313] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGH for action security_group_rules [ 1030.220447] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGH for action security_group_rules [ 1030.220648] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef0125d-be94-4dc6-922c-269322ae2b97 with Priority: HIGH for action security_group_rules [ 1030.220730] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGH for action security_group_rules [ 1030.220797] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb with Priority: HIGH for action security_group_rules [ 1030.220919] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 with Priority: HIGH for action security_group_rules [ 1030.221080] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGH for action security_group_rules [ 1030.221195] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 with Priority: HIGH for action security_group_rules [ 1030.221311] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e414027f-367d-4f4e-abad-e74bd2a6a762 with Priority: HIGH for action security_group_rules [ 1030.221420] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGH for action security_group_rules [ 1030.221534] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b692d00-090d-4fca-8b85-19b077d9435b with Priority: HIGH for action security_group_rules [ 1030.221677] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1c820f-c032-491e-a171-042f82234545 with Priority: HIGH for action security_group_rules [ 1030.221826] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGH for action security_group_rules [ 1030.221998] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb with Priority: HIGH for action security_group_rules [ 1030.222174] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 with Priority: HIGH for action security_group_rules [ 1030.222710] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc95494-492e-4f83-a225-dc8ad461b515 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.222710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.222901] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70dd2e08-5d3c-47df-8c82-524cc320dde0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.223101] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.223213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.223524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.223722] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70dd2e08-5d3c-47df-8c82-524cc320dde0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.225458] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.225458] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.225668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.225752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.225807] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.227202] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.227337] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.227414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.227660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.227660] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.228858] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3015041e-e0eb-4083-abbf-3bfc49610323 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.229075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.229075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.229255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.229323] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3015041e-e0eb-4083-abbf-3bfc49610323',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.230583] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d711f143-3c86-4518-9590-301f0739c6ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.230687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.230687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.230935] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.231032] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d711f143-3c86-4518-9590-301f0739c6ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.232709] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.232853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.233072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.233301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.233424] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.234959] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e666168c-26eb-4fba-8f02-30bb3eb590d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.235108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.235221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.235442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.235550] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.237356] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bef0125d-be94-4dc6-922c-269322ae2b97 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.237478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.237546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.238182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.238182] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bef0125d-be94-4dc6-922c-269322ae2b97',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.240620] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.240620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.240620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.240620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.240620] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.241799] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59435e15-2dcf-4317-816e-1fcd9a40b9fb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.241799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.241799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.241799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.241799] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59435e15-2dcf-4317-816e-1fcd9a40b9fb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.243031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d89bba3e-b2fe-4856-b21c-5154e1f55eb5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.243031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.243031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.243031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.243290] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d89bba3e-b2fe-4856-b21c-5154e1f55eb5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.244529] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.244529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.244529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.245157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.245459] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.246671] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-732ce2ac-f7fb-41f5-ac97-eceb113118d9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.247110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.247110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.247110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.247241] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('732ce2ac-f7fb-41f5-ac97-eceb113118d9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.248388] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e414027f-367d-4f4e-abad-e74bd2a6a762 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.248495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.248591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.248791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.248894] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e414027f-367d-4f4e-abad-e74bd2a6a762',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.250172] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.250264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.250459] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b692d00-090d-4fca-8b85-19b077d9435b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.250705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.250932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.250991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.251039] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b692d00-090d-4fca-8b85-19b077d9435b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.251788] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf1c820f-c032-491e-a171-042f82234545 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.251924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.251989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.252220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.252220] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf1c820f-c032-491e-a171-042f82234545',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.252930] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.253312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.253401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.253559] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.253659] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.254739] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.254867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.254934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.255141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.255211] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34e0fe86-bdd4-47ec-be48-37e9cf6eaafb',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.256393] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa5afa51-af91-4a18-91ea-ad8cbadae183 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.256643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.256643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.256719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.258021] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa5afa51-af91-4a18-91ea-ad8cbadae183',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.319647] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.320204] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.320204] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.320467] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.320773] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.320961] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.321097] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.321356] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.321672] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.321946] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.321946] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.322159] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.322159] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.322369] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.322606] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.322606] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.324333] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.324489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.324574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.324692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.324783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.325144] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.325144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.325302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.325302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.325389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.325521] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 already deleted. [ 1030.325592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.353195] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.353637] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1030.353637] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.353637] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.353980] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-689aba7f-31af-4116-8b4e-bcec10c9c5ba taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.354178] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-689aba7f-31af-4116-8b4e-bcec10c9c5ba" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.354431] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-689aba7f-31af-4116-8b4e-bcec10c9c5ba" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.354720] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-689aba7f-31af-4116-8b4e-bcec10c9c5ba" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.355476] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('689aba7f-31af-4116-8b4e-bcec10c9c5ba',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.554228] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: SUCCESS [ 1030.554676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.554962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.555461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.555669] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.580029] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.580222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.580297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.580527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.580644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.580745] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc95494-492e-4f83-a225-dc8ad461b515 already deleted. [ 1030.580853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.581360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.581593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.581683] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc95494-492e-4f83-a225-dc8ad461b515',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.729735] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.729986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.729986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.730246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.730468] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.730592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.730685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.730892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.730994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.731169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.731280] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.740088] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e666168c-26eb-4fba-8f02-30bb3eb590d8 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.740088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.740088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.740088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.740088] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.740088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.740088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.740088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.740088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.740088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.740088] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.749117] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.749319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.749373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.749599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.749849] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.750044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.750167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.750440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.750604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.750750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.750894] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.756253] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.756409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.756456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.756623] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.762240] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.762240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.767637] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.767776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.767830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.768041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.768205] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.768689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.768689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.768689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.768689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.768689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.770010] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.782167] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.782167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.790336] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.790620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.858755] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.859676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.859676] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.859847] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.859991] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.860289] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 689aba7f-31af-4116-8b4e-bcec10c9c5ba not found, creating... [ 1030.860540] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.860729] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.860868] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.861236] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.861400] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.861832] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.862016] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.862154] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.862408] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.862528] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.862679] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 689aba7f-31af-4116-8b4e-bcec10c9c5ba is going to be created. [ 1030.919839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.919839] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.921200] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.921341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.922974] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.922974] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.923963] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.924095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.925097] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.925321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.926103] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.926204] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.926948] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.927059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.932331] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.932465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.933405] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.933519] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.934487] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1030.935494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.935494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.935605] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1030.936051] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.936155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.936834] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1030.937294] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.937397] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70dd2e08-5d3c-47df-8c82-524cc320dde0 is going to be deleted. [ 1030.938492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.938617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.966034] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.966034] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.966034] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.966034] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.966034] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.966375] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-689aba7f-31af-4116-8b4e-bcec10c9c5ba" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.002473] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.002757] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 is going to be deleted. [ 1031.004444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.004679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.024979] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.025192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.058053] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.058276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.058421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.058674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.058839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.058928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.059074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.059179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.059267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.059358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.059463] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.065388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.065587] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d711f143-3c86-4518-9590-301f0739c6ea is going to be deleted. [ 1031.066607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.066869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.103653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.103806] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be deleted. [ 1031.104963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.105235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.121070] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.121279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.141635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.141785] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be deleted. [ 1031.142870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.143123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.220839] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.220994] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d89bba3e-b2fe-4856-b21c-5154e1f55eb5 is going to be deleted. [ 1031.222073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.222300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.223878] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.224031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.226399] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.226540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.241204] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.243186] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.253691] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.253946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.254116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.254379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.254601] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.254735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.254809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.255014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.255107] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.255200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.255354] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.255447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.255508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.255650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.255796] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.255884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.255944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.256100] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.256178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.256271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.256363] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.267818] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1031.268082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.268254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.268473] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.268713] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.268835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.268892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.269077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.269165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.269255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.269368] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.277858] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.278053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.278258] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.282803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.282933] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e414027f-367d-4f4e-abad-e74bd2a6a762 is going to be deleted. [ 1031.284189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.285042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.286093] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.286203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.322447] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.322599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.401075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.401463] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b692d00-090d-4fca-8b85-19b077d9435b is going to be deleted. [ 1031.402263] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.402654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.405360] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: SUCCESS [ 1031.405555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.434371] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.434836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.453026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.453026] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3015041e-e0eb-4083-abbf-3bfc49610323 is going to be deleted. [ 1031.453026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.453026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.484026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.484026] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf1c820f-c032-491e-a171-042f82234545 is going to be deleted. [ 1031.484026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.484026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.566025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.566025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.566025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.566025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.566025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.566802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.566802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.566802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.566802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.566802] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.568471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.568726] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34e0fe86-bdd4-47ec-be48-37e9cf6eaafb is going to be deleted. [ 1031.571087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.571087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.602488] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.602488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.614025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.614025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59435e15-2dcf-4317-816e-1fcd9a40b9fb is going to be deleted. [ 1031.614025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.614554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.621906] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.622355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.635282] env[62909]: INFO networking_nsxv3.common.synchronization [req-562f8be8-0367-44cc-898e-d176a5444cb8 req-986a1674-ef7d-42b5-ae0e-9f88b40940e2 service nova] Enqueued Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_rules [ 1031.635282] env[62909]: INFO networking_nsxv3.common.synchronization [req-562f8be8-0367-44cc-898e-d176a5444cb8 req-986a1674-ef7d-42b5-ae0e-9f88b40940e2 service nova] Enqueued Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_members [ 1031.635282] env[62909]: INFO networking_nsxv3.common.synchronization [req-562f8be8-0367-44cc-898e-d176a5444cb8 req-986a1674-ef7d-42b5-ae0e-9f88b40940e2 service nova] Enqueued Resource ID: 689aba7f-31af-4116-8b4e-bcec10c9c5ba with Priority: HIGHEST for action port [ 1031.635282] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_rules [ 1031.635282] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_members [ 1031.635282] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689aba7f-31af-4116-8b4e-bcec10c9c5ba with Priority: HIGHEST for action port [ 1031.635724] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.636127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.636449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.637029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.637029] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a69ff3e-5b01-4156-a417-d9c5f614e7e4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.638049] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.638265] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.638381] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.638662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.638977] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.639188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.639545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.639788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.639951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.640138] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a69ff3e-5b01-4156-a417-d9c5f614e7e4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.641379] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-689aba7f-31af-4116-8b4e-bcec10c9c5ba taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.641677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-689aba7f-31af-4116-8b4e-bcec10c9c5ba" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.641788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-689aba7f-31af-4116-8b4e-bcec10c9c5ba" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.642062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-689aba7f-31af-4116-8b4e-bcec10c9c5ba" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.642213] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('689aba7f-31af-4116-8b4e-bcec10c9c5ba',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.644397] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.644595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.676213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.676450] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa5afa51-af91-4a18-91ea-ad8cbadae183 is going to be deleted. [ 1031.678392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.678717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.746628] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e666168c-26eb-4fba-8f02-30bb3eb590d8: rpc.has_security_group_logging(os_id): False [ 1031.748192] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23297eee-5815-4160-b6ed-90818fa0ab3a: rpc.has_security_group_logging(os_id): False [ 1031.758869] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f6e0db7-41ba-43f5-b841-2551ea96a39f: rpc.has_security_group_logging(os_id): False [ 1031.772193] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.772442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.772442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.772684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.772861] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.772960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.773040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.773201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.773289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.773382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.773526] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.773620] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.773721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.773915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.774071] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.774173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.774224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.774379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.774476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.774561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.774652] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.780338] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ef8091d-5beb-460c-8d49-21cf9cd46551: rpc.has_security_group_logging(os_id): False [ 1031.817303] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.817437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.819341] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.819488] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.868824] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.869052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.874604] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.874773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.879104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.879254] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 732ce2ac-f7fb-41f5-ac97-eceb113118d9 is going to be deleted. [ 1031.880439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.880669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.882238] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.882372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.918558] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.918777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.938391] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.938629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.952928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.953123] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bef0125d-be94-4dc6-922c-269322ae2b97 is going to be deleted. [ 1031.954268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.954599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.954717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.955050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70dd2e08-5d3c-47df-8c82-524cc320dde0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.955261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.955453] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.955548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.955657] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc95494-492e-4f83-a225-dc8ad461b515 already deleted. [ 1031.955756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.956576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.956885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.957039] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.957223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d711f143-3c86-4518-9590-301f0739c6ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.957380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.957580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.957668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.957792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.957976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.958186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.958261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.958379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.958556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.958654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.958729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.958844] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.959016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.959212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.959289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.959402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d89bba3e-b2fe-4856-b21c-5154e1f55eb5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.959574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.959673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.959752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.959853] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e414027f-367d-4f4e-abad-e74bd2a6a762" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.959976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.960188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.960188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.960302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b692d00-090d-4fca-8b85-19b077d9435b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.960426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.960564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.960647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.960804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3015041e-e0eb-4083-abbf-3bfc49610323" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.960997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.961180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.961246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.961349] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf1c820f-c032-491e-a171-042f82234545" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.961509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.961670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.023640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.023957] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.024119] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.024187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.024409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.024500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.024720] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.024837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.024900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.025148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.025196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.025405] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.025489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.025553] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.025701] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.025793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.025894] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 1032.027138] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.027315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.068100] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ada642ef-0700-436a-87e6-5df9c7267f20: rpc.has_security_group_logging(os_id): False [ 1032.094885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.095313] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.095567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.095567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.095838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.096125] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.096275] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 is going to be updated. [ 1032.097629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.097849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.099567] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.099709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.115967] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.116182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.135145] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.135566] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.135697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.135797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.136011] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.136141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.136257] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1032.137438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.137692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.137777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.137900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59435e15-2dcf-4317-816e-1fcd9a40b9fb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.138091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.138273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.138393] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.138561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa5afa51-af91-4a18-91ea-ad8cbadae183" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.139586] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.139699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.139796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.140035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.140167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.140368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bef0125d-be94-4dc6-922c-269322ae2b97" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.140581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.140828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.144697] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a69ff3e-5b01-4156-a417-d9c5f614e7e4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.147373] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.147373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.147373] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 689aba7f-31af-4116-8b4e-bcec10c9c5ba with status ACTIVE [ 1032.147373] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.147373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.147373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.147373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.147373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.147373] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.147373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.147373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.147989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.147989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.147989] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.147989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.147989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.148151] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.148176] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.148313] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 689aba7f-31af-4116-8b4e-bcec10c9c5ba is going to be updated. [ 1032.191397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.191902] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.192048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.192124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.192443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.192577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.192718] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 1032.194013] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.194231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.232166] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.232363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.232363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.232733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.232882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.233082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-689aba7f-31af-4116-8b4e-bcec10c9c5ba" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.276830] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57568fd4-ee2b-43e3-a228-9a168490f0f5: rpc.has_security_group_logging(os_id): False [ 1032.280448] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.280448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.293910] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.293910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.331254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.331599] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.331743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.331814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.332083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.332215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.332442] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.332554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.332633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.332825] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.332892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.333130] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.333236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.333304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.333429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.333575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.333633] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ada642ef-0700-436a-87e6-5df9c7267f20 is going to be updated. [ 1032.335357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.335357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.335357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.335357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-732ce2ac-f7fb-41f5-ac97-eceb113118d9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.335595] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.335621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.335724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.335869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34e0fe86-bdd4-47ec-be48-37e9cf6eaafb" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.336430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.336430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.336540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.337634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.337829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.338020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.342928] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.343095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.343156] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.343335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.415648] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.416063] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.417009] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 1032.424936] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.425143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.451055] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 in Status: IN_PROGRESS for 2s [ 1032.452554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.452868] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.452994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.453077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.453312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.453390] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.453596] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.453716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.453846] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.454079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.454171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.454357] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.454456] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.454522] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.454688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.454806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.454912] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1032.456127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.456302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.456476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.457562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.457766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.457952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.508514] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 1032.509321] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1032.549969] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.550209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.550209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.550452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.550628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.593084] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: IN_PROGRESS for 2s [ 1032.646621] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a69ff3e-5b01-4156-a417-d9c5f614e7e4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.663849] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1032.664647] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.664964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.665085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.665351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.665629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.689158] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1033.149082] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.149082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.149082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.149330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.149471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.149512] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 is going to be created. [ 1033.174105] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.174324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.174324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.174546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.174717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.184398] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 in Status: UNINITIALIZED for 2s [ 1034.430253] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 1034.430686] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.466591] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 in Status: SUCCESS [ 1034.466808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.522020] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 1034.522391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.523388] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1034.523628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.610357] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: SUCCESS [ 1034.610597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.713324] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1034.713710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.714503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.714781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.714905] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.197064] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 in Status: SUCCESS [ 1035.198274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.198274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.198274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.198274] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.198274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.198274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.198274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.198274] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.198516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.198516] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a69ff3e-5b01-4156-a417-d9c5f614e7e4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.217786] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.218452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.218635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.218871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.219214] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.219405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.219484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.221329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.221329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.221329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.221329] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.701433] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a69ff3e-5b01-4156-a417-d9c5f614e7e4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.724702] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.724702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.724702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.724702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.724702] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.724702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.724702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.724702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.725310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.725538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.725788] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.725997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.727016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.727016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.727016] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.727016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.727016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.727016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.727016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.727016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.727016] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.203266] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a69ff3e-5b01-4156-a417-d9c5f614e7e4: rpc.has_security_group_logging(os_id): False [ 1036.222871] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.222871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.223146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.223295] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.223388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.223645] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.223730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.223795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.223983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.224227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.224286] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 is going to be created. [ 1036.230158] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57568fd4-ee2b-43e3-a228-9a168490f0f5: rpc.has_security_group_logging(os_id): False [ 1036.258167] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.258379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.258479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.258726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.258831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.259158] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.259289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.259443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.259612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.259718] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.260054] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.260233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.260323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.260443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.260519] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.260747] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.260830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.260889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.261042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.261188] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.261325] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1036.320272] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.320272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.320272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.320425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.320621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.326897] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.327093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.327142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.327314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.327450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.334714] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 in Status: IN_PROGRESS for 2s [ 1036.340425] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1036.550605] env[62909]: INFO networking_nsxv3.common.synchronization [None req-be4d5d9d-26fe-4db2-b556-28b67fcc9ccf tempest-AttachVolumeShelveTestJSON-1170767985 tempest-AttachVolumeShelveTestJSON-1170767985-project-member] Enqueued Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_rules [ 1036.551232] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_rules [ 1036.551568] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.551754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.551857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.552745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.552842] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.824621] env[62909]: INFO networking_nsxv3.common.synchronization [None req-cdde45d9-d420-4449-9bf2-8d3fd66c9adf tempest-AttachVolumeShelveTestJSON-1170767985 tempest-AttachVolumeShelveTestJSON-1170767985-project-member] Enqueued Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_rules [ 1036.825194] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_rules [ 1036.825539] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.825703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.924834] env[62909]: INFO networking_nsxv3.common.synchronization [req-6175afb3-fd48-45a2-b157-3f809a37a4b9 req-5bad7bc6-b4ea-48ec-9c86-1f49aec62992 tempest-ServersAdminTestJSON-1709758822 tempest-ServersAdminTestJSON-1709758822-project-member] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 1036.925449] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 1036.926255] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.926886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.926996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.927239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.931648] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.931648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.931648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.931648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.931648] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.931648] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.082245] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.082245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.082245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.082245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.082245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.082245] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 already deleted. [ 1037.082245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.082942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.083340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.083570] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.432819] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.606029] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.606029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.606029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.606241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.606314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.606410] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 already deleted. [ 1037.606490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.938533] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.348723] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 in Status: SUCCESS [ 1038.348984] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.357250] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1038.357250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.441120] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.441273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.441341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.441559] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.441714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.441835] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 1038.483380] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.483542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.483615] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.483830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.484069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.495708] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 1040.507629] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 1040.508044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.927801] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1041.928147] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1042.589337] env[62909]: INFO networking_nsxv3.common.synchronization [req-a45c5c48-0c15-4fb0-84ef-14f715847e28 req-9a25f84d-3326-4863-b884-3098d5a55faf tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 1042.589994] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGHEST for action security_group_members [ 1042.590557] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.590681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1042.590748] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.590942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1042.591312] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.591312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1042.591312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.591409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1042.591529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1042.591615] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.097528] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.097854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1043.097854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.098247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.122166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.122735] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.122735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1043.122735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.123044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.123044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.123096] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 is going to be updated. [ 1043.152373] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.152531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1043.152531] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.152829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.153123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.164647] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: IN_PROGRESS for 2s [ 1045.176458] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 in Status: SUCCESS [ 1045.176865] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 deletion is rescheduled due to dependency. [ 1045.176865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.389093] env[62909]: INFO networking_nsxv3.common.synchronization [req-a2069353-0bc3-4dbd-9b40-a60fd96741bc req-28aa7d7e-254d-448e-9203-f4edcca24218 tempest-ImagesOneServerNegativeTestJSON-373251561 tempest-ImagesOneServerNegativeTestJSON-373251561-project-member] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1045.389254] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1045.389560] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.389672] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.389742] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.389976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.390147] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.390247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.390698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.390698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.390698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.390698] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.606738] env[62909]: INFO networking_nsxv3.common.synchronization [req-5162f392-cf9b-46cc-9abe-aa10324f3b2c req-a57bc69b-53f2-40ee-b252-604a9b71e0dc tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 1045.607365] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 1045.607682] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.607794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.607874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.608069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.608220] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.608316] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.608374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.608544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.608625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.608717] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.895795] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.895945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.896021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.896241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.896329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.896522] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.896616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.896675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.898633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.900174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.900174] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be deleted. [ 1045.949608] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.949877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.949877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.950055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.950111] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.950257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.111069] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.111262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.111368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.112174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.112174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.112174] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.112174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.112174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.112418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.112451] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.112540] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 1046.160328] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.160328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.160328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.160328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.160328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.168273] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 1046.283790] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.284185] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.284185] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.287498] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.287498] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.287498] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.287498] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.287498] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.287498] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.287498] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.287498] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.287498] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.287498] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.287498] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.287498] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.287498] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.312605] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.312921] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1046.313181] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.313487] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.313992] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-ac958614-7d81-4f75-b8a8-abc5e626a182 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.314518] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-ac958614-7d81-4f75-b8a8-abc5e626a182" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.314809] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-ac958614-7d81-4f75-b8a8-abc5e626a182" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.315353] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-ac958614-7d81-4f75-b8a8-abc5e626a182" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.315685] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac958614-7d81-4f75-b8a8-abc5e626a182',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.819678] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.819678] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.819678] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.819678] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.819678] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.819678] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port ac958614-7d81-4f75-b8a8-abc5e626a182 not found, creating... [ 1046.820230] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.820285] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.820682] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.820775] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.820916] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.821342] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.821521] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.821717] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.822181] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.822181] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.822343] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: ac958614-7d81-4f75-b8a8-abc5e626a182 is going to be created. [ 1046.847657] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.847893] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.848084] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.848381] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.848620] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.848849] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-ac958614-7d81-4f75-b8a8-abc5e626a182" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.904402] env[62909]: INFO networking_nsxv3.common.synchronization [req-a2069353-0bc3-4dbd-9b40-a60fd96741bc req-22362cc9-721c-4c90-9312-dfb581fcd6ee service nova] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_rules [ 1047.904781] env[62909]: INFO networking_nsxv3.common.synchronization [req-a2069353-0bc3-4dbd-9b40-a60fd96741bc req-22362cc9-721c-4c90-9312-dfb581fcd6ee service nova] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1047.905169] env[62909]: INFO networking_nsxv3.common.synchronization [req-a2069353-0bc3-4dbd-9b40-a60fd96741bc req-22362cc9-721c-4c90-9312-dfb581fcd6ee service nova] Enqueued Resource ID: ac958614-7d81-4f75-b8a8-abc5e626a182 with Priority: HIGHEST for action port [ 1047.905862] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_rules [ 1047.906071] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1047.906269] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac958614-7d81-4f75-b8a8-abc5e626a182 with Priority: HIGHEST for action port [ 1047.906556] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.906731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.906814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.907073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.907364] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.910787] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.910787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.910787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.910787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.910787] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.910787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.910787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.910787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.910787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.910787] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.911371] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac958614-7d81-4f75-b8a8-abc5e626a182 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.912267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac958614-7d81-4f75-b8a8-abc5e626a182" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.912267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac958614-7d81-4f75-b8a8-abc5e626a182" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.912628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac958614-7d81-4f75-b8a8-abc5e626a182" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.912628] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac958614-7d81-4f75-b8a8-abc5e626a182',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.177846] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 1048.178038] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f deletion is rescheduled due to dependency. [ 1048.178152] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.417926] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.418212] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.418320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.418855] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac958614-7d81-4f75-b8a8-abc5e626a182 with status ACTIVE [ 1048.419801] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.419801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.419801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.419801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.420055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.420118] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.420535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.420535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.420619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.420711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.421017] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.421159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.421252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.421480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.421594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.421720] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac958614-7d81-4f75-b8a8-abc5e626a182 is going to be updated. [ 1048.445389] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.445616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.445725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.446037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.446252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.446649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac958614-7d81-4f75-b8a8-abc5e626a182" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.805491] env[62909]: INFO networking_nsxv3.common.synchronization [req-28b9f87d-e75e-43de-8c6e-5c5fb97bbf7e req-58dc58d7-6e08-4735-8e32-38c7aba40ceb tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_members [ 1048.806093] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_members [ 1048.806452] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc95494-492e-4f83-a225-dc8ad461b515 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.806590] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.806658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.806995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.807144] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.807270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.807357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.807556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.807650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.807739] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc95494-492e-4f83-a225-dc8ad461b515',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.919312] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.313365] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.313365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.313365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.313365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.313365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.313365] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.313365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.313365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.313365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.313365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.313365] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc95494-492e-4f83-a225-dc8ad461b515 already deleted. [ 1049.313365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.422880] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.423157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.423312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.423647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.423781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.423925] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be created. [ 1049.454232] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.454428] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.454473] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.454670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.454893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.469676] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: UNINITIALIZED for 2s [ 1049.495289] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-96 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.495943] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.495943] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.495943] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.497705] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.497925] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.498078] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.498418] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.498624] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.498861] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.498979] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.499111] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.499228] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.499346] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.500387] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.500387] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.523309] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.523309] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1049.523309] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.523309] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.523309] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-57890d0b-660c-4230-8104-4d1ae53eb7ce taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.523309] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-57890d0b-660c-4230-8104-4d1ae53eb7ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.524431] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-57890d0b-660c-4230-8104-4d1ae53eb7ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.524431] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-57890d0b-660c-4230-8104-4d1ae53eb7ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.524431] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57890d0b-660c-4230-8104-4d1ae53eb7ce',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.027164] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.027560] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.027560] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.027827] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.027977] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.028539] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 57890d0b-660c-4230-8104-4d1ae53eb7ce not found, creating... [ 1050.028539] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.028682] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.028772] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.028985] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.029143] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.029426] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.029585] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.029703] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.029950] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.030143] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.030299] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 57890d0b-660c-4230-8104-4d1ae53eb7ce is going to be created. [ 1050.053384] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.053667] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.053887] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.054340] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.054611] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.054947] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-57890d0b-660c-4230-8104-4d1ae53eb7ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.173149] env[62909]: INFO networking_nsxv3.common.synchronization [req-28b9f87d-e75e-43de-8c6e-5c5fb97bbf7e req-13449e45-3812-4fba-b472-752db5067105 service nova] Enqueued Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_rules [ 1051.173402] env[62909]: INFO networking_nsxv3.common.synchronization [req-28b9f87d-e75e-43de-8c6e-5c5fb97bbf7e req-13449e45-3812-4fba-b472-752db5067105 service nova] Enqueued Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_members [ 1051.173466] env[62909]: INFO networking_nsxv3.common.synchronization [req-28b9f87d-e75e-43de-8c6e-5c5fb97bbf7e req-13449e45-3812-4fba-b472-752db5067105 service nova] Enqueued Resource ID: 57890d0b-660c-4230-8104-4d1ae53eb7ce with Priority: HIGHEST for action port [ 1051.173704] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_rules [ 1051.173831] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_members [ 1051.173928] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57890d0b-660c-4230-8104-4d1ae53eb7ce with Priority: HIGHEST for action port [ 1051.174470] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc95494-492e-4f83-a225-dc8ad461b515 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.174591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.174652] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.174932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.174932] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc95494-492e-4f83-a225-dc8ad461b515',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.175714] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc95494-492e-4f83-a225-dc8ad461b515 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.175824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.175891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.176069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.177660] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.177772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.177837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.177992] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.178091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.178205] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc95494-492e-4f83-a225-dc8ad461b515',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.178948] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-57890d0b-660c-4230-8104-4d1ae53eb7ce taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.179071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57890d0b-660c-4230-8104-4d1ae53eb7ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.179136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57890d0b-660c-4230-8104-4d1ae53eb7ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.179288] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57890d0b-660c-4230-8104-4d1ae53eb7ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.179557] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57890d0b-660c-4230-8104-4d1ae53eb7ce',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.346407] env[62909]: INFO networking_nsxv3.common.synchronization [req-37fb4965-30e1-4b3f-953c-8401d6b32514 req-89cc5504-cfc3-4bdb-8a0c-5be6e4a5f621 tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1051.346962] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1051.347310] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.347441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.347510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.347711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.347862] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.347962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.351116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.351380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.351504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.351616] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.487849] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: SUCCESS [ 1051.487849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.487849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.487849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.487849] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.487849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.487849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.487849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.487849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.487849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.487849] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.681055] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bc95494-492e-4f83-a225-dc8ad461b515',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.685022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc95494-492e-4f83-a225-dc8ad461b515 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.685022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.685022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57890d0b-660c-4230-8104-4d1ae53eb7ce with status ACTIVE [ 1051.685022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.685022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.685022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.685022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.685022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.685022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.685022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.685022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.685022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.685022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.685022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.685730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.685730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.685730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.685730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.685730] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57890d0b-660c-4230-8104-4d1ae53eb7ce is going to be updated. [ 1051.705772] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.705912] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.705988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.706224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.706375] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.706530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57890d0b-660c-4230-8104-4d1ae53eb7ce" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.708514] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.708741] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.708883] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.709136] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.709394] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.709552] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.709671] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.709894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.710047] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.710256] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.710373] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.710486] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.710599] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.710711] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.710822] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.710961] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.731963] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.731963] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1051.731963] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.732142] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.733370] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-5c3a4ef5-fd55-4dee-8a2a-9710098285f4 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.733370] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-5c3a4ef5-fd55-4dee-8a2a-9710098285f4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.733370] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-5c3a4ef5-fd55-4dee-8a2a-9710098285f4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.733370] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-5c3a4ef5-fd55-4dee-8a2a-9710098285f4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.733653] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c3a4ef5-fd55-4dee-8a2a-9710098285f4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.855493] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.990083] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.990420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.990420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.990580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.990723] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.990938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.990979] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.991147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.991233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.991378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.991469] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.991555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.991649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.991755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.991941] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.992064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.992131] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.992359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.992359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.992408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.992507] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.183275] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bc95494-492e-4f83-a225-dc8ad461b515',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.236798] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.237037] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.237203] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.237503] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.237654] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.237811] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 5c3a4ef5-fd55-4dee-8a2a-9710098285f4 not found, creating... [ 1052.238086] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.238249] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.238372] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.238617] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.238761] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.239068] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.239230] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.239349] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.239553] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.239685] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.239825] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 5c3a4ef5-fd55-4dee-8a2a-9710098285f4 is going to be created. [ 1052.273445] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.273651] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.273782] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.274130] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.274392] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.274662] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-5c3a4ef5-fd55-4dee-8a2a-9710098285f4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.358875] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.494656] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc: rpc.has_security_group_logging(os_id): False [ 1052.523575] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.523827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.523827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.524074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.524171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.524416] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.524544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.524599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.524731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.524801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.525036] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.525140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.525192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.525610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.525610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.525610] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.525817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.525817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.525905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.525905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.525988] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be created. [ 1052.599160] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.599363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.599363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.599580] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.599813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.612115] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: IN_PROGRESS for 2s [ 1052.686284] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.686492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.686535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.686794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.686910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.687025] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc95494-492e-4f83-a225-dc8ad461b515 is going to be created. [ 1052.728171] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.728358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.728736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.728736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.728913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.738453] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc95494-492e-4f83-a225-dc8ad461b515 in Status: UNINITIALIZED for 2s [ 1052.751416] env[62909]: INFO networking_nsxv3.common.synchronization [req-30df9e5b-0765-49ef-84c5-4d31ce64fd92 req-640711c7-3647-4925-aadf-b19397b59333 tempest-ServerActionsTestOtherB-1631848678 tempest-ServerActionsTestOtherB-1631848678-project-member] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 1052.752185] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 1052.752585] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.752738] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.752895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.753061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.753235] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.753359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.753425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.753582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.755398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.755398] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.864810] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.864986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.865040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.865268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.865387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.865501] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1052.895221] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.895221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.895221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.895221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.895221] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.907237] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1053.261018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.261509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.261509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.261509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.261758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.261758] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.261952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.261952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.262110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.262174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.262340] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 1053.300246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.300437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.300523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.300808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.300967] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.315849] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 1053.466430] env[62909]: INFO networking_nsxv3.common.synchronization [req-37fb4965-30e1-4b3f-953c-8401d6b32514 req-5af46945-ebad-4944-a96c-45a4e821fa2d service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 1053.466430] env[62909]: INFO networking_nsxv3.common.synchronization [req-37fb4965-30e1-4b3f-953c-8401d6b32514 req-5af46945-ebad-4944-a96c-45a4e821fa2d service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1053.466430] env[62909]: INFO networking_nsxv3.common.synchronization [req-37fb4965-30e1-4b3f-953c-8401d6b32514 req-5af46945-ebad-4944-a96c-45a4e821fa2d service nova] Enqueued Resource ID: 5c3a4ef5-fd55-4dee-8a2a-9710098285f4 with Priority: HIGHEST for action port [ 1053.466430] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 1053.466430] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1053.466430] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c3a4ef5-fd55-4dee-8a2a-9710098285f4 with Priority: HIGHEST for action port [ 1053.466430] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.466430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.466430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.466430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.469544] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.470235] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.470346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.470551] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c3a4ef5-fd55-4dee-8a2a-9710098285f4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.470651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c3a4ef5-fd55-4dee-8a2a-9710098285f4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.470719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c3a4ef5-fd55-4dee-8a2a-9710098285f4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.470909] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c3a4ef5-fd55-4dee-8a2a-9710098285f4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.470984] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c3a4ef5-fd55-4dee-8a2a-9710098285f4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.973928] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.974105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.975482] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c3a4ef5-fd55-4dee-8a2a-9710098285f4 with status ACTIVE [ 1053.976327] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.976327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.976327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.976327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.976327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.976632] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.976632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.976632] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.976739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.976824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.977015] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.977129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.977215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.977363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.977434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.977519] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c3a4ef5-fd55-4dee-8a2a-9710098285f4 is going to be updated. [ 1054.001812] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.002049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.002130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.002334] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.002464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.002619] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c3a4ef5-fd55-4dee-8a2a-9710098285f4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.386193] env[62909]: INFO networking_nsxv3.common.synchronization [req-3a3c7aa5-3262-49da-9b40-75d09a0801fa req-e4c66e02-dfa3-43b2-965d-b5b7de6d1069 tempest-ServersAdminTestJSON-1709758822 tempest-ServersAdminTestJSON-1709758822-project-member] Enqueued Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 1054.386740] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 with Priority: HIGHEST for action security_group_members [ 1054.389601] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.390082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.390082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.390082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.390261] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.390347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.390397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.390561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.390649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.390750] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.626989] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: SUCCESS [ 1054.627326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.749975] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc95494-492e-4f83-a225-dc8ad461b515 in Status: SUCCESS [ 1054.750597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.750597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.750726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.750898] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.751026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.751082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.751275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.751361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.751509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.751570] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bc95494-492e-4f83-a225-dc8ad461b515',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.895122] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.895328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.895396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.895629] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.919022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1054.919022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.919022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.919022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.919022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.919022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.919022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.919022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.919022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.919022] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.920272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.920623] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.920870] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.921033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.921297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.921462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.921729] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 is going to be updated. [ 1054.949849] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.950018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.950083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.950384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.950544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.960595] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: IN_PROGRESS for 2s [ 1055.258068] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bc95494-492e-4f83-a225-dc8ad461b515',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.297193] env[62909]: INFO networking_nsxv3.common.synchronization [None req-67a93f64-90d1-4cc3-b52c-359f9394066c tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_rules [ 1055.297804] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_rules [ 1055.299152] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.299329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.299721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.299721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.299849] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaab03b-ddb9-4244-b03d-9b5a1b7172bd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.325701] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 1055.325796] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a deletion is rescheduled due to dependency. [ 1055.325857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.424777] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.473880] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e3f2d686-b22e-4916-a606-d0ab4f35269a tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_rules [ 1055.474455] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_rules [ 1055.474762] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.474863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.760509] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bc95494-492e-4f83-a225-dc8ad461b515: rpc.has_security_group_logging(os_id): False [ 1055.781889] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.781889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.781889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.782326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.782438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.782698] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.782796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.783029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.783104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.783163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.783210] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc95494-492e-4f83-a225-dc8ad461b515 is going to be created. [ 1055.821076] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.821309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.821400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.821673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.821773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.821918] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd already deleted. [ 1055.822067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.822312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.822515] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.822628] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaab03b-ddb9-4244-b03d-9b5a1b7172bd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.868718] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.868873] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.868951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.869203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.869388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.882419] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc95494-492e-4f83-a225-dc8ad461b515 in Status: IN_PROGRESS for 2s [ 1055.930480] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.346167] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.346167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.346167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.346167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.346167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.346167] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd already deleted. [ 1056.346167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.433820] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.434220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.434802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.435000] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.435164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.435303] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1056.484859] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.485067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.485132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.485364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.485529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.499451] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1056.970783] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 in Status: SUCCESS [ 1056.970783] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5 deletion is rescheduled due to dependency. [ 1056.970783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.896200] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc95494-492e-4f83-a225-dc8ad461b515 in Status: SUCCESS [ 1057.896536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.212581] env[62909]: INFO networking_nsxv3.common.synchronization [req-a1810532-bb3b-4777-931f-cb51aab8e5f9 req-036d9473-2718-462e-9bba-d8da85fcfa53 tempest-AttachVolumeShelveTestJSON-1170767985 tempest-AttachVolumeShelveTestJSON-1170767985-project-member] Enqueued Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_members [ 1058.212581] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_members [ 1058.212581] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.212581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.212581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.212581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.212581] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.212581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.212581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.212581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.212581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.213565] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.512022] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1058.512022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.512022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.512022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.512022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.512022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.512022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.512022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.512022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.512022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.512022] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.590021] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.590021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.590021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.590021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.590021] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.590021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.590021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.590021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.590021] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.590743] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.591031] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.591263] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.591462] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.591670] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.591867] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.592144] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.617041] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.617041] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1058.617041] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.617041] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.617335] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-8d6d259f-1ebc-4e49-b6f8-114f414606f7 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.617335] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.617529] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.617730] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.617868] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d6d259f-1ebc-4e49-b6f8-114f414606f7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.720290] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.720290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.720290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.720290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.720290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.720565] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.720565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.720565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.720671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.720698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.721210] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 already deleted. [ 1058.721666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.999431] env[62909]: INFO networking_nsxv3.common.synchronization [None req-8b46e960-6d65-4892-98af-d60ffba1bffb tempest-ServerRescueNegativeTestJSON-298244947 tempest-ServerRescueNegativeTestJSON-298244947-project-member] Enqueued Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_rules [ 1059.000333] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_rules [ 1059.000699] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d3ccded-cd6f-45c9-87f4-02e27e787128 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.000849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.000929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.001413] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.001413] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d3ccded-cd6f-45c9-87f4-02e27e787128',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.016251] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.016419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.016484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.016686] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.016849] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.016952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.017026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.017181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.017269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.017357] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.017501] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.017605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.017681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.017794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.017941] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.018043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.018102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.018239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.018440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.018528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.018614] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.079509] env[62909]: INFO networking_nsxv3.common.synchronization [None req-2e5fa8b0-cdb3-449f-968b-09bb898702f5 tempest-ServerRescueNegativeTestJSON-298244947 tempest-ServerRescueNegativeTestJSON-298244947-project-member] Enqueued Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_rules [ 1059.080025] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_rules [ 1059.080331] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d3ccded-cd6f-45c9-87f4-02e27e787128 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.080422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.120660] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.120895] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.121042] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.121982] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.121982] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.121982] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 8d6d259f-1ebc-4e49-b6f8-114f414606f7 not found, creating... [ 1059.121982] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.122330] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.122330] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.122500] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.122640] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.122942] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.123343] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.123422] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.123657] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.123803] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.123994] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 8d6d259f-1ebc-4e49-b6f8-114f414606f7 is going to be created. [ 1059.145164] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.145463] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.145550] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.145838] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.146161] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.146467] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.520671] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57568fd4-ee2b-43e3-a228-9a168490f0f5: rpc.has_security_group_logging(os_id): False [ 1059.523268] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.523470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.523521] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.523841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.523841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.523948] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 already deleted. [ 1059.523977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.524140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.524447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.524447] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d3ccded-cd6f-45c9-87f4-02e27e787128',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.538025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.538369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.538369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.538477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.538520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.538734] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.538830] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.538909] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.539146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.539230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.539464] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.539520] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.539786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.539786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.539786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.539991] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.540068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.540298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.540298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.540377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.540404] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1059.626126] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.626280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.626353] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.626572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.626720] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.653294] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1060.045941] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.046314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.046314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.046394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.046466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.047046] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 already deleted. [ 1060.047046] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.170322] env[62909]: INFO networking_nsxv3.common.synchronization [req-a1810532-bb3b-4777-931f-cb51aab8e5f9 req-51e34fdb-d013-48c3-ad4a-7aa5ed6f0c23 service nova] Enqueued Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_rules [ 1060.170503] env[62909]: INFO networking_nsxv3.common.synchronization [req-a1810532-bb3b-4777-931f-cb51aab8e5f9 req-51e34fdb-d013-48c3-ad4a-7aa5ed6f0c23 service nova] Enqueued Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_members [ 1060.170644] env[62909]: INFO networking_nsxv3.common.synchronization [req-a1810532-bb3b-4777-931f-cb51aab8e5f9 req-51e34fdb-d013-48c3-ad4a-7aa5ed6f0c23 service nova] Enqueued Resource ID: 8d6d259f-1ebc-4e49-b6f8-114f414606f7 with Priority: HIGHEST for action port [ 1060.170875] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_rules [ 1060.171010] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_members [ 1060.171140] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6d259f-1ebc-4e49-b6f8-114f414606f7 with Priority: HIGHEST for action port [ 1060.171759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.171882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.171966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.172255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.172333] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.174607] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.174607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.174607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.174607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.174607] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.174607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.174607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.174607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.174607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.174922] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.175512] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d6d259f-1ebc-4e49-b6f8-114f414606f7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.175600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.175703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.175810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.175878] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d6d259f-1ebc-4e49-b6f8-114f414606f7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.603448] env[62909]: INFO networking_nsxv3.common.synchronization [req-6bc399ae-154d-4c30-87e7-9b79384da7bb req-5c2699dd-7ade-4023-8399-dc257d8e0404 tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1060.604227] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1060.604589] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.604748] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.604790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.605057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.609016] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.609016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.609016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.609016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.609016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.609016] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.681026] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.681026] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.681026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.681026] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d6d259f-1ebc-4e49-b6f8-114f414606f7 with status ACTIVE [ 1060.681026] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.681026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.681026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.681026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.681026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.681026] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.681026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.681026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.681026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.681026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.681705] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.681705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.681705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.681705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.681705] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.681705] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d6d259f-1ebc-4e49-b6f8-114f414606f7 is going to be updated. [ 1060.716154] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.716154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.716154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.716154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.716154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.716154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.108268] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.108680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.108680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.108756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.130441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.130441] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.130441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.130441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.130441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.130441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.130441] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1061.155775] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.155859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.155934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.156173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.156315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.166853] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1061.184110] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.669616] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1061.669848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.686619] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.686821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.686821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.687074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.687170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.687268] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 is going to be created. [ 1061.714242] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.714432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.714483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.714682] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.714881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.723766] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 in Status: UNINITIALIZED for 2s [ 1062.943668] env[62909]: INFO networking_nsxv3.common.synchronization [None req-3a15e37e-f440-4b00-9d16-7390b348fd02 tempest-AttachInterfacesTestJSON-714396526 tempest-AttachInterfacesTestJSON-714396526-project-member] Enqueued Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 1062.944103] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 with Priority: HIGHEST for action security_group_members [ 1062.944504] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.944638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.944837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.944906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.945088] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.945195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.945257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.945406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.945487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.945578] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e66bfb9-974f-43a6-93f8-54f17b7d81b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.177174] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1063.177403] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 1063.177466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.448339] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.448339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.448339] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.448635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.448635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.448715] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.448906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.448906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.449017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.449099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.449250] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e66bfb9-974f-43a6-93f8-54f17b7d81b3 is going to be deleted. [ 1063.487469] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.487618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.487691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.487911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.488012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.488122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e66bfb9-974f-43a6-93f8-54f17b7d81b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.738110] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 in Status: SUCCESS [ 1063.738417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.738596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.738864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.739054] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.739178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.739245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.741040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.741127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.741262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.741319] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.243649] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.745856] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cd42ad4-be75-455d-aff0-14bd3f6e0236: rpc.has_security_group_logging(os_id): False [ 1064.766095] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.766095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.766095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.766752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.766752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.766752] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.766752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.766752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.766997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.766997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.767112] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 is going to be created. [ 1064.837224] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.837452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.837524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.837862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.838130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.852530] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 in Status: IN_PROGRESS for 2s [ 1065.230185] env[62909]: INFO networking_nsxv3.common.synchronization [req-ae5280c3-7aec-44b1-a171-21f916eb352d req-5bb408bd-a59a-4dbd-9e14-eb63d230f9a1 tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 1065.230721] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 1065.231350] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.231479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.231573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.231740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.231896] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.231998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.232347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.232513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.232604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.232700] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.734533] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.735301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.735301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.735301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.735301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.735301] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.735492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.735492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.735740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.735740] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.735740] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 1065.779798] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.780124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.780197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.780397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.780564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.790721] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 1065.795702] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.795964] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.796049] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.796312] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.796577] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.796854] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.796854] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.798054] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.798334] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.798511] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.798636] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.798751] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.798864] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.802020] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.802020] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.802020] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.820962] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.821063] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1065.821199] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.821427] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-624" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.821731] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-27ba2416-757a-4a8b-a7a5-f3d585ce4899 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.822256] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-27ba2416-757a-4a8b-a7a5-f3d585ce4899" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.822256] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-27ba2416-757a-4a8b-a7a5-f3d585ce4899" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.822428] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-27ba2416-757a-4a8b-a7a5-f3d585ce4899" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.822576] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27ba2416-757a-4a8b-a7a5-f3d585ce4899',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.325253] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.325573] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.325723] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.326291] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.326628] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.326883] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 27ba2416-757a-4a8b-a7a5-f3d585ce4899 not found, creating... [ 1066.327294] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.327776] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.328477] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.328814] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.329109] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.329571] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.329912] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.330187] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.331164] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.331164] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.331164] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 27ba2416-757a-4a8b-a7a5-f3d585ce4899 is going to be created. [ 1066.359466] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.359685] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.359799] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.360122] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.360426] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.360674] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-27ba2416-757a-4a8b-a7a5-f3d585ce4899" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.868459] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 in Status: SUCCESS [ 1066.868679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.312614] env[62909]: INFO networking_nsxv3.common.synchronization [req-ae5280c3-7aec-44b1-a171-21f916eb352d req-92450899-9b71-4dbc-849b-849026bd6c51 service nova] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_rules [ 1067.312889] env[62909]: INFO networking_nsxv3.common.synchronization [req-ae5280c3-7aec-44b1-a171-21f916eb352d req-92450899-9b71-4dbc-849b-849026bd6c51 service nova] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 1067.313166] env[62909]: INFO networking_nsxv3.common.synchronization [req-ae5280c3-7aec-44b1-a171-21f916eb352d req-92450899-9b71-4dbc-849b-849026bd6c51 service nova] Enqueued Resource ID: 27ba2416-757a-4a8b-a7a5-f3d585ce4899 with Priority: HIGHEST for action port [ 1067.313703] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_rules [ 1067.313862] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 1067.313932] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27ba2416-757a-4a8b-a7a5-f3d585ce4899 with Priority: HIGHEST for action port [ 1067.314218] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.314344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.314412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.314628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.314704] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.315570] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.315669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.315982] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-27ba2416-757a-4a8b-a7a5-f3d585ce4899 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.315982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27ba2416-757a-4a8b-a7a5-f3d585ce4899" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.316127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27ba2416-757a-4a8b-a7a5-f3d585ce4899" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.316209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27ba2416-757a-4a8b-a7a5-f3d585ce4899" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.316286] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27ba2416-757a-4a8b-a7a5-f3d585ce4899',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.800481] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 1067.800734] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f deletion is rescheduled due to dependency. [ 1067.800805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.801173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.801330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.802068] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.802068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.802068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.802068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.802068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.802068] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.819078] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.819282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.819465] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27ba2416-757a-4a8b-a7a5-f3d585ce4899 with status ACTIVE [ 1067.819703] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.820422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.820422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.820422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.820621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.821845] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.821845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.821845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.821845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.821845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.821845] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.821845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.821845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.821845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.821845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.821845] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27ba2416-757a-4a8b-a7a5-f3d585ce4899 is going to be updated. [ 1067.848199] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.848349] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.848419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.848626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.848758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.848915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27ba2416-757a-4a8b-a7a5-f3d585ce4899" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.130035] env[62909]: INFO networking_nsxv3.common.synchronization [req-e8153c14-2e38-4273-8b6f-0d6898123eb3 req-bffd0170-967f-451b-a655-7cda98d7491a tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1068.130733] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1068.130946] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.131084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.131156] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.131353] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.131506] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.131600] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.131662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.131803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.131906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.131997] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.303859] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.639306] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.807553] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.142354] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.319253] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.319253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.319253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.319253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.319253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.319253] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 1069.348586] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.348755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.348755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.348976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.349140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.359023] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 1069.592544] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b554265c-972f-4aee-afa9-20e7f2132d49 None None] Enqueued Resource ID: b221d63f-7c50-41ae-ae30-730002f9e2f9 with Priority: HIGHEST for action port [ 1069.592544] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b221d63f-7c50-41ae-ae30-730002f9e2f9 with Priority: HIGHEST for action port [ 1069.593237] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b221d63f-7c50-41ae-ae30-730002f9e2f9 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.593839] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b221d63f-7c50-41ae-ae30-730002f9e2f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.594050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b221d63f-7c50-41ae-ae30-730002f9e2f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.594434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b221d63f-7c50-41ae-ae30-730002f9e2f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.594620] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b221d63f-7c50-41ae-ae30-730002f9e2f9',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.646623] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.647547] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.647690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.648018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.648170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.648374] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1069.681590] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.681889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.681993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.684514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.684762] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.701028] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1070.101276] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b221d63f-7c50-41ae-ae30-730002f9e2f9 [ 1070.101276] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.101276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.101276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.101276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.101276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.101276] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b221d63f-7c50-41ae-ae30-730002f9e2f9 already deleted. [ 1070.101276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b221d63f-7c50-41ae-ae30-730002f9e2f9" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.475239] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-65 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.475603] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.475603] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.475900] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.476967] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.477181] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.477306] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.477541] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.477683] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.477894] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.478016] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.478127] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.478242] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.478353] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.478457] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.478589] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.500631] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.500926] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1070.501195] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.501456] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-65" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.501793] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-00706251-f634-4dcb-9705-105152de241f taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.502080] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.502371] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.502747] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.505119] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00706251-f634-4dcb-9705-105152de241f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.008438] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.009169] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.009169] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.009383] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.009543] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.010026] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.010283] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.010864] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.010864] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.010864] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.011276] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.011523] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.011690] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.011976] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.012203] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.012795] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 00706251-f634-4dcb-9705-105152de241f is going to be updated. [ 1071.035605] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.036178] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.036375] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.036984] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.037255] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.037659] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.145057] env[62909]: INFO networking_nsxv3.common.synchronization [None req-c4914ac0-299e-488a-80ad-dfc18fa0838c tempest-ServerActionsV293TestJSON-301243714 tempest-ServerActionsV293TestJSON-301243714-project-member] Enqueued Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_rules [ 1071.145361] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_rules [ 1071.145676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.145797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.145863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.147898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.150763] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.243317] env[62909]: INFO networking_nsxv3.common.synchronization [None req-839be456-b2a1-4fe4-b231-99e96df281d9 tempest-ServerActionsV293TestJSON-301243714 tempest-ServerActionsV293TestJSON-301243714-project-member] Enqueued Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_rules [ 1071.243937] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_rules [ 1071.248268] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.248412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.373230] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 1071.373230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.373230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.373230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.373584] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.373584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.373584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.373584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.373780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.373780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.373869] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.684806] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.685207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.685207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.685273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.685324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.685417] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 already deleted. [ 1071.685592] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.687093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.687313] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.687405] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.713137] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1071.713461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.880097] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.881732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.881732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.881732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.881732] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.881732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.881732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.881732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.881732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.882231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.882231] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.882231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.882231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.882399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.882606] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.882606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.883050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.883050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.883050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.883050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.883340] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.019425] env[62909]: INFO networking_nsxv3.common.synchronization [req-027f2ac0-aedc-4763-9b42-d4b958031541 req-2a60d4b7-3d7a-4329-8472-d634043c26d5 service nova] Enqueued Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_rules [ 1072.019838] env[62909]: INFO networking_nsxv3.common.synchronization [req-027f2ac0-aedc-4763-9b42-d4b958031541 req-2a60d4b7-3d7a-4329-8472-d634043c26d5 service nova] Enqueued Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 1072.019838] env[62909]: INFO networking_nsxv3.common.synchronization [req-027f2ac0-aedc-4763-9b42-d4b958031541 req-2a60d4b7-3d7a-4329-8472-d634043c26d5 service nova] Enqueued Resource ID: 00706251-f634-4dcb-9705-105152de241f with Priority: HIGHEST for action port [ 1072.020325] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_rules [ 1072.020469] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 1072.020556] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00706251-f634-4dcb-9705-105152de241f with Priority: HIGHEST for action port [ 1072.021346] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.021745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.021745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.021745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.021895] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.023331] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.023331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.023459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.023552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.023692] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.023822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.023884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.024934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.025680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.026046] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.028173] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-00706251-f634-4dcb-9705-105152de241f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.028308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.028913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.028957] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.029052] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00706251-f634-4dcb-9705-105152de241f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.207343] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.207523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.207523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.207809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.207809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.207934] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 already deleted. [ 1072.207980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.388075] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f6e0db7-41ba-43f5-b841-2551ea96a39f: rpc.has_security_group_logging(os_id): False [ 1072.410713] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.410713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.410713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.410713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.410713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.410965] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.411123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.411185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.411356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.411423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.411615] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.411738] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.411841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.413033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.413302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.413726] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.413928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.414052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.414269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.414399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.416496] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 1072.500715] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.500888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.500978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.501240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.502017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.515818] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 1072.534896] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.535970] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.535970] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.535970] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00706251-f634-4dcb-9705-105152de241f with status ACTIVE [ 1072.535970] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.536276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.536276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.536348] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.536441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.536620] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.536716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.536788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.539698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.539698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.539698] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.539698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.539698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.539698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.539698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.539698] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00706251-f634-4dcb-9705-105152de241f is going to be updated. [ 1072.574504] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.574722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.574722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.574914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.576447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.576447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00706251-f634-4dcb-9705-105152de241f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.040093] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.115412] env[62909]: INFO networking_nsxv3.common.synchronization [req-119bf824-11b3-492a-ae7e-f8f92961aaf9 req-be77cf80-7dd8-480c-ab65-99c1c1ce0d2b tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_members [ 1073.116033] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_members [ 1073.116288] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.116751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.116751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.116859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.117425] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.117425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.117425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.117559] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.117678] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.117713] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaab03b-ddb9-4244-b03d-9b5a1b7172bd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.415948] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ffa237fa-06a7-47d7-81e5-8b24de8691af None None] Enqueued Resource ID: 9217ed6c-b351-4fcd-ba41-b1953b068a10 with Priority: HIGHEST for action port [ 1073.416564] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9217ed6c-b351-4fcd-ba41-b1953b068a10 with Priority: HIGHEST for action port [ 1073.416891] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-9217ed6c-b351-4fcd-ba41-b1953b068a10 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.417049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9217ed6c-b351-4fcd-ba41-b1953b068a10" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.417117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9217ed6c-b351-4fcd-ba41-b1953b068a10" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.417406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9217ed6c-b351-4fcd-ba41-b1953b068a10" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.417512] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9217ed6c-b351-4fcd-ba41-b1953b068a10',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.520167] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.520167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.520167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.520167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.520167] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.520167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.520167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.520167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.520167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.521037] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1073.521373] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.521604] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.521807] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.522018] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1073.522322] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.522633] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.545090] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.545090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.545090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.545090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.545090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.545090] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd is going to be updated. [ 1073.546107] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.549019] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1073.549019] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.549019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.549019] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-371d22eb-8e46-423e-b4cc-a52d3dbc0879 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.549019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-371d22eb-8e46-423e-b4cc-a52d3dbc0879" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.549019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-371d22eb-8e46-423e-b4cc-a52d3dbc0879" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.549019] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-371d22eb-8e46-423e-b4cc-a52d3dbc0879" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.549019] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('371d22eb-8e46-423e-b4cc-a52d3dbc0879',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.578619] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.579885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.580019] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.580300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.580521] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.595238] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: IN_PROGRESS for 2s [ 1073.623183] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.623645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.623738] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.623951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.624054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.624265] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.624527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.624527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.624597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.624794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.624794] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd already deleted. [ 1073.624890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.895482] env[62909]: INFO networking_nsxv3.common.synchronization [req-814a8f80-99f9-4d6d-8b21-8bb77b5ccacc req-1c368783-7f3b-41ec-a9eb-63b4a47907da tempest-ImagesOneServerNegativeTestJSON-373251561 tempest-ImagesOneServerNegativeTestJSON-373251561-project-member] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1073.897645] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1073.897645] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.897645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.897645] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.898083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.898292] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.898405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.898728] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.898728] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.898728] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.898839] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.920289] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9217ed6c-b351-4fcd-ba41-b1953b068a10 [ 1073.920391] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.920900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.920900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.920900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.920900] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.921116] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9217ed6c-b351-4fcd-ba41-b1953b068a10 already deleted. [ 1073.921116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9217ed6c-b351-4fcd-ba41-b1953b068a10" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.052412] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.052412] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.052412] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.052412] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.052948] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.052948] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 371d22eb-8e46-423e-b4cc-a52d3dbc0879 not found, creating... [ 1074.052948] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.053219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.053219] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.057509] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.057509] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.057509] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.057509] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.057509] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.057509] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.057509] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.057509] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 371d22eb-8e46-423e-b4cc-a52d3dbc0879 is going to be created. [ 1074.079346] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.079586] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.079687] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.079978] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.081038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.081038] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-371d22eb-8e46-423e-b4cc-a52d3dbc0879" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.402148] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.402378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.402431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.402644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.402733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.403385] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.403385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.403385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.403385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.403385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.403385] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be updated. [ 1074.432649] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.432783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.432865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.433132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.433300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.443121] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: IN_PROGRESS for 2s [ 1074.529895] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 1074.530179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.933752] env[62909]: INFO networking_nsxv3.common.synchronization [req-119bf824-11b3-492a-ae7e-f8f92961aaf9 req-9910a96d-e1af-4537-b2a6-a746b22dff21 service nova] Enqueued Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_rules [ 1074.933752] env[62909]: INFO networking_nsxv3.common.synchronization [req-119bf824-11b3-492a-ae7e-f8f92961aaf9 req-9910a96d-e1af-4537-b2a6-a746b22dff21 service nova] Enqueued Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_members [ 1074.933752] env[62909]: INFO networking_nsxv3.common.synchronization [req-119bf824-11b3-492a-ae7e-f8f92961aaf9 req-9910a96d-e1af-4537-b2a6-a746b22dff21 service nova] Enqueued Resource ID: 371d22eb-8e46-423e-b4cc-a52d3dbc0879 with Priority: HIGHEST for action port [ 1074.933752] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_rules [ 1074.933752] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_members [ 1074.933752] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371d22eb-8e46-423e-b4cc-a52d3dbc0879 with Priority: HIGHEST for action port [ 1074.933752] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.933752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.933752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.933752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.933752] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaab03b-ddb9-4244-b03d-9b5a1b7172bd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.935142] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.935304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.935412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.935706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.935912] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.936036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.936104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.936266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.936354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.936465] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaab03b-ddb9-4244-b03d-9b5a1b7172bd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.937317] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-371d22eb-8e46-423e-b4cc-a52d3dbc0879 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.937444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-371d22eb-8e46-423e-b4cc-a52d3dbc0879" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.937517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-371d22eb-8e46-423e-b4cc-a52d3dbc0879" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.937684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-371d22eb-8e46-423e-b4cc-a52d3dbc0879" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.937768] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('371d22eb-8e46-423e-b4cc-a52d3dbc0879',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.383500] env[62909]: INFO networking_nsxv3.common.synchronization [req-52ec0873-4b56-4a4d-b9ff-ed918ebf2524 req-88899881-717d-4fc4-8554-2d4219fa17e1 tempest-ServerRescueNegativeTestJSON-298244947 tempest-ServerRescueNegativeTestJSON-298244947-project-member] Enqueued Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_members [ 1075.384050] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_members [ 1075.384359] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ccded-cd6f-45c9-87f4-02e27e787128 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.384474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.384538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.384847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.385000] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.385109] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.386901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.386901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.386901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.386901] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d3ccded-cd6f-45c9-87f4-02e27e787128',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.442193] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.442193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.442193] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 371d22eb-8e46-423e-b4cc-a52d3dbc0879 with status ACTIVE [ 1075.442193] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.442193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.442193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.442193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.442193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.442193] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.442193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.442193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.442193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.442193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.442193] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.443017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.443017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.443017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.443017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.443017] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 371d22eb-8e46-423e-b4cc-a52d3dbc0879 is going to be updated. [ 1075.444224] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbaab03b-ddb9-4244-b03d-9b5a1b7172bd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.471824] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.471824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.471824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.471824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.471824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.471824] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-371d22eb-8e46-423e-b4cc-a52d3dbc0879" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.610245] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: SUCCESS [ 1075.610245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.610245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.610245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.610245] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.610245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.610584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.610584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.610656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.610750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.610847] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.887992] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.887992] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.887992] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.888745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.889040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.889460] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.889722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.891354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.891354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.891354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.891354] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 already deleted. [ 1075.891354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.946015] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbaab03b-ddb9-4244-b03d-9b5a1b7172bd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.117550] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.117753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.117819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.118067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.118287] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.118402] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.118612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.118786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.118902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.119042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.119306] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.119408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.119472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.119651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.119829] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.119948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.124666] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.124841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.124841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.125165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.125355] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.293057] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.293290] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.293451] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.293753] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.294823] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.294973] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.295112] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.295383] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.295535] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.295759] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1076.295871] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.295983] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.296104] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.296354] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1076.296503] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.296648] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.319456] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.319980] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1076.320855] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.321048] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-871" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.321421] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-d3377942-1cea-43ef-8a80-ebe5519d491c taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.321606] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-d3377942-1cea-43ef-8a80-ebe5519d491c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.321749] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-d3377942-1cea-43ef-8a80-ebe5519d491c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.322344] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-d3377942-1cea-43ef-8a80-ebe5519d491c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.322617] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3377942-1cea-43ef-8a80-ebe5519d491c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.448252] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.448583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.448583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.449020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.449142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.449266] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd is going to be created. [ 1076.456697] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: SUCCESS [ 1076.456697] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc deletion is rescheduled due to dependency. [ 1076.456697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.501290] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.501444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.501533] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.501836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.503355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.528542] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd in Status: UNINITIALIZED for 2s [ 1076.628942] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f28a45c0-8394-4cec-b3b7-949be46fb2dd: rpc.has_security_group_logging(os_id): False [ 1076.646864] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.647479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.647479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.647479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.675010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.675322] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.675443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.675550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.675730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.675809] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.676015] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.676122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.676186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.676384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.676497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.676759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.676911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.677028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.677224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.677345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.677483] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd is going to be updated. [ 1076.746039] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.746215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.746304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.746610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.746610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.760932] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: IN_PROGRESS for 2s [ 1076.827028] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.827028] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.827231] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.827366] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.827548] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.827786] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port d3377942-1cea-43ef-8a80-ebe5519d491c not found, creating... [ 1076.828374] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.828497] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.828669] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.829026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.829263] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.829717] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.829969] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.830222] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.830660] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.830857] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.831010] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: d3377942-1cea-43ef-8a80-ebe5519d491c is going to be created. [ 1076.862177] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.862177] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.862177] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.862177] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.862177] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.862177] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-d3377942-1cea-43ef-8a80-ebe5519d491c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.023161] env[62909]: INFO networking_nsxv3.common.synchronization [None req-ae51ee66-fadf-446b-b3a9-4df5f7ecf09f None None] Enqueued Resource ID: 6a84e457-1111-4697-a4f8-25a58ac72434 with Priority: HIGHEST for action port [ 1077.024069] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a84e457-1111-4697-a4f8-25a58ac72434 with Priority: HIGHEST for action port [ 1077.025795] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a84e457-1111-4697-a4f8-25a58ac72434 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.026810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a84e457-1111-4697-a4f8-25a58ac72434" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.026940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a84e457-1111-4697-a4f8-25a58ac72434" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.027289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a84e457-1111-4697-a4f8-25a58ac72434" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.027386] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a84e457-1111-4697-a4f8-25a58ac72434',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.530062] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a84e457-1111-4697-a4f8-25a58ac72434 [ 1077.530455] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.530564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.530564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.530983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.530983] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.530983] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a84e457-1111-4697-a4f8-25a58ac72434 already deleted. [ 1077.531260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a84e457-1111-4697-a4f8-25a58ac72434" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.757683] env[62909]: INFO networking_nsxv3.common.synchronization [req-5869ba7e-3d6f-4071-9c31-3d7ff0a39943 req-9c1b8b0e-c6f0-4e0d-923d-f3b5587f8468 tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1077.758381] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1077.758760] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.758919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.759026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.759481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.759643] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.759764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.759857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.760044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.760168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.761081] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.960366] env[62909]: INFO networking_nsxv3.common.synchronization [req-52ec0873-4b56-4a4d-b9ff-ed918ebf2524 req-ffd76bc5-0c24-49c5-8721-6968b1b551b2 service nova] Enqueued Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_rules [ 1077.960563] env[62909]: INFO networking_nsxv3.common.synchronization [req-52ec0873-4b56-4a4d-b9ff-ed918ebf2524 req-ffd76bc5-0c24-49c5-8721-6968b1b551b2 service nova] Enqueued Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_members [ 1077.960702] env[62909]: INFO networking_nsxv3.common.synchronization [req-52ec0873-4b56-4a4d-b9ff-ed918ebf2524 req-ffd76bc5-0c24-49c5-8721-6968b1b551b2 service nova] Enqueued Resource ID: d3377942-1cea-43ef-8a80-ebe5519d491c with Priority: HIGHEST for action port [ 1077.961897] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_rules [ 1077.961897] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_members [ 1077.961897] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3377942-1cea-43ef-8a80-ebe5519d491c with Priority: HIGHEST for action port [ 1077.961897] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d3ccded-cd6f-45c9-87f4-02e27e787128 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.962177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.962177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.962369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.962475] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d3ccded-cd6f-45c9-87f4-02e27e787128',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.963605] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ccded-cd6f-45c9-87f4-02e27e787128 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.963678] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.963724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.963926] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.964066] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.964155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.964212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.964347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.964457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.964571] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d3ccded-cd6f-45c9-87f4-02e27e787128',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.965461] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3377942-1cea-43ef-8a80-ebe5519d491c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.965589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3377942-1cea-43ef-8a80-ebe5519d491c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.965669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3377942-1cea-43ef-8a80-ebe5519d491c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.965817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3377942-1cea-43ef-8a80-ebe5519d491c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.965888] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3377942-1cea-43ef-8a80-ebe5519d491c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.172746] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.172981] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.173135] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.173425] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.173714] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.173898] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.174479] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.176244] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.176244] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.176244] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.176244] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.176244] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.176244] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.176244] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.176244] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.176244] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.200880] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.201024] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1078.201079] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.201321] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.201605] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-e159d0dc-e550-43fb-aa88-9a9b59bdc767 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.201780] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-e159d0dc-e550-43fb-aa88-9a9b59bdc767" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.201894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-e159d0dc-e550-43fb-aa88-9a9b59bdc767" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.202279] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-e159d0dc-e550-43fb-aa88-9a9b59bdc767" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.202521] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e159d0dc-e550-43fb-aa88-9a9b59bdc767',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.268937] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.269350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.269618] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.269928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.270090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.270365] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.270564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.270665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.270881] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.271033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.271173] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1078.313733] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.313733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.313733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.313974] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.314177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.325119] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1078.468261] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ccded-cd6f-45c9-87f4-02e27e787128 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.468534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.468655] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d3ccded-cd6f-45c9-87f4-02e27e787128',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.469978] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3377942-1cea-43ef-8a80-ebe5519d491c with status ACTIVE [ 1078.469978] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.469978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.470168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.470462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.470554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.470797] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.470917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.470980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.471246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.471246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.471416] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.471512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.471565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.471818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.471882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.471956] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3377942-1cea-43ef-8a80-ebe5519d491c is going to be updated. [ 1078.497697] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.497909] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.497909] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.498133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.498367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.498551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3377942-1cea-43ef-8a80-ebe5519d491c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.538886] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd in Status: SUCCESS [ 1078.539230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.539282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.539457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.539640] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.539756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.539821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.539973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.540271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.540399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.540509] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbaab03b-ddb9-4244-b03d-9b5a1b7172bd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.705397] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.705665] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.705872] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.706228] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.706421] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.706646] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port e159d0dc-e550-43fb-aa88-9a9b59bdc767 not found, creating... [ 1078.706971] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.707193] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.707354] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.707685] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.707880] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.708236] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.708363] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.708486] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.708701] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.708834] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.708979] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: e159d0dc-e550-43fb-aa88-9a9b59bdc767 is going to be created. [ 1078.732906] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.733253] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.733397] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.735328] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.735328] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.735328] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-e159d0dc-e550-43fb-aa88-9a9b59bdc767" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.781541] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: SUCCESS [ 1078.782127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.975105] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d3ccded-cd6f-45c9-87f4-02e27e787128',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.044284] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbaab03b-ddb9-4244-b03d-9b5a1b7172bd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.279448] env[62909]: INFO networking_nsxv3.common.synchronization [req-51d02cb5-c0b4-4b72-ba9e-33ca8c7cedc2 req-d0070881-a9f9-4abe-b861-93c1efb7cdfd tempest-ServerDiskConfigTestJSON-253234715 tempest-ServerDiskConfigTestJSON-253234715-project-member] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 1079.279448] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGHEST for action security_group_members [ 1079.279448] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.279448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.279448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.280260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.280669] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.281141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.281332] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.281610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.282189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.282189] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.476895] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.477407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.477788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.478286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.478534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.480489] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 is going to be created. [ 1079.505311] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.508027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.508027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.508027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.508027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.517645] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 in Status: UNINITIALIZED for 2s [ 1079.547145] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbaab03b-ddb9-4244-b03d-9b5a1b7172bd: rpc.has_security_group_logging(os_id): False [ 1079.552902] env[62909]: INFO networking_nsxv3.common.synchronization [req-5869ba7e-3d6f-4071-9c31-3d7ff0a39943 req-52db6841-bf83-432e-99ee-0728f946efce service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 1079.553785] env[62909]: INFO networking_nsxv3.common.synchronization [req-5869ba7e-3d6f-4071-9c31-3d7ff0a39943 req-52db6841-bf83-432e-99ee-0728f946efce service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1079.553785] env[62909]: INFO networking_nsxv3.common.synchronization [req-5869ba7e-3d6f-4071-9c31-3d7ff0a39943 req-52db6841-bf83-432e-99ee-0728f946efce service nova] Enqueued Resource ID: e159d0dc-e550-43fb-aa88-9a9b59bdc767 with Priority: HIGHEST for action port [ 1079.555077] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 1079.555077] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1079.555077] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e159d0dc-e550-43fb-aa88-9a9b59bdc767 with Priority: HIGHEST for action port [ 1079.555077] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.555077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.555398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.555398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.555537] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.556557] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.556557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.557044] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-e159d0dc-e550-43fb-aa88-9a9b59bdc767 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.557044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e159d0dc-e550-43fb-aa88-9a9b59bdc767" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.557044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e159d0dc-e550-43fb-aa88-9a9b59bdc767" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.557248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e159d0dc-e550-43fb-aa88-9a9b59bdc767" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.557305] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e159d0dc-e550-43fb-aa88-9a9b59bdc767',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.567106] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.567689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.567689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.567689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.567689] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.567943] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.567943] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.568045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.568794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.568794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.568794] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd is going to be created. [ 1079.631967] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.632175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.632215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.632436] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.632624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.644248] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd in Status: IN_PROGRESS for 2s [ 1079.705615] env[62909]: INFO networking_nsxv3.common.synchronization [None req-b522321c-87f5-458b-a7d7-013a9e881507 None None] Enqueued Resource ID: 5acac494-27b3-462c-b90b-e1ab0ebd527f with Priority: HIGHEST for action port [ 1079.705866] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5acac494-27b3-462c-b90b-e1ab0ebd527f with Priority: HIGHEST for action port [ 1079.706491] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5acac494-27b3-462c-b90b-e1ab0ebd527f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.706639] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5acac494-27b3-462c-b90b-e1ab0ebd527f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.706695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5acac494-27b3-462c-b90b-e1ab0ebd527f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.706951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5acac494-27b3-462c-b90b-e1ab0ebd527f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.707054] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5acac494-27b3-462c-b90b-e1ab0ebd527f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.786679] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.786877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.787030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.787171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.787265] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.787480] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.787581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.787634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.787839] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.787891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.787950] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be updated. [ 1079.827793] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.828497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.828497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.828497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.828497] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.839849] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: IN_PROGRESS for 2s [ 1080.060450] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.060695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.060882] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e159d0dc-e550-43fb-aa88-9a9b59bdc767 with status ACTIVE [ 1080.061111] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.061254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.061335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.061551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.061635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.061805] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.061905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.061964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.062121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.062191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.062398] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.062498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.062635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.062811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.062886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.062970] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e159d0dc-e550-43fb-aa88-9a9b59bdc767 is going to be updated. [ 1080.093212] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.093392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.093459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.093692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.093864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.094046] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e159d0dc-e550-43fb-aa88-9a9b59bdc767" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.208830] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5acac494-27b3-462c-b90b-e1ab0ebd527f [ 1080.209129] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.209265] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.209331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.209538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.209649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.209716] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5acac494-27b3-462c-b90b-e1ab0ebd527f already deleted. [ 1080.209796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5acac494-27b3-462c-b90b-e1ab0ebd527f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.344059] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1080.344263] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 1080.344362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.344545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.344754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.345186] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.345186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.345186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.345356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.345356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.345444] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.624948] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff3a5c93-3e37-4790-ae27-568716c64199 req-05978c8d-43c4-4d82-afd9-6486df59c117 tempest-ServerActionsTestOtherB-1631848678 tempest-ServerActionsTestOtherB-1631848678-project-member] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 1080.625711] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 1080.626078] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.626212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.626287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.626507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.626709] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.626815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.626891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.627078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.627149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.628279] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.851789] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.001962] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.002181] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.002312] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.002775] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.003196] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.003395] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.003600] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.004143] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.004143] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.004399] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.004535] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.004657] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.004818] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.004964] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.005132] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.005286] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.027864] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.028062] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1081.028205] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.028428] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.028707] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-949a1716-cbb0-44a7-a0f6-4d27a45071e0 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.028910] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.029054] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.029487] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.029644] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('949a1716-cbb0-44a7-a0f6-4d27a45071e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.133031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.133031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.133031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.133299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.133348] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.133556] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.133684] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.133736] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.133857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.133930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.134032] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 1081.162920] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.163235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.163289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.163579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.163734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.175814] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 1081.353597] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.531845] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.532933] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.533152] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.533553] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.533731] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.533903] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 949a1716-cbb0-44a7-a0f6-4d27a45071e0 not found, creating... [ 1081.534232] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.534411] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.534532] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.534781] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.534915] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.536893] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.537263] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.537565] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.538227] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.538495] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.538764] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 949a1716-cbb0-44a7-a0f6-4d27a45071e0 is going to be created. [ 1081.541643] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 in Status: SUCCESS [ 1081.542097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.542344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.542616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.542850] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.543041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.543329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.543585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.543924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.544099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.544258] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d3ccded-cd6f-45c9-87f4-02e27e787128',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.572426] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.572648] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.572772] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.573145] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.573446] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.573702] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.672770] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd in Status: SUCCESS [ 1081.672770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.857166] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f in Status: SUCCESS [ 1081.857369] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f deletion is rescheduled due to dependency. [ 1081.857537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.857975] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.858157] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.858240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.858905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.858905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.858905] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1081.906973] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.906973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.906973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.906973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.906973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.929825] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1082.048370] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d3ccded-cd6f-45c9-87f4-02e27e787128',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.466285] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff3a5c93-3e37-4790-ae27-568716c64199 req-d9f4970a-c57f-499f-bb1c-bba35f97dfed service nova] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 1082.466285] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff3a5c93-3e37-4790-ae27-568716c64199 req-d9f4970a-c57f-499f-bb1c-bba35f97dfed service nova] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 1082.466285] env[62909]: INFO networking_nsxv3.common.synchronization [req-ff3a5c93-3e37-4790-ae27-568716c64199 req-d9f4970a-c57f-499f-bb1c-bba35f97dfed service nova] Enqueued Resource ID: 949a1716-cbb0-44a7-a0f6-4d27a45071e0 with Priority: HIGHEST for action port [ 1082.466285] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 1082.466285] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 1082.466285] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 949a1716-cbb0-44a7-a0f6-4d27a45071e0 with Priority: HIGHEST for action port [ 1082.467114] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.467634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.467839] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.468150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.468617] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.469950] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.470182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.470497] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-949a1716-cbb0-44a7-a0f6-4d27a45071e0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.470743] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.472018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.472018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.472018] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('949a1716-cbb0-44a7-a0f6-4d27a45071e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.550572] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d3ccded-cd6f-45c9-87f4-02e27e787128: rpc.has_security_group_logging(os_id): False [ 1082.576650] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.576752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.576790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.577114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.577244] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.577561] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.577691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.577765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.578012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.578083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.578629] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 is going to be created. [ 1082.662620] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.662829] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.662896] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.663147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.663259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.684539] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 in Status: IN_PROGRESS for 2s [ 1082.974517] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.974714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.974837] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 949a1716-cbb0-44a7-a0f6-4d27a45071e0 with status ACTIVE [ 1082.975011] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.975196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.975196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.975429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.975541] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.975747] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.975866] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.975866] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.976029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.976342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.976342] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.976558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.976558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.976707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.976707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.976789] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 949a1716-cbb0-44a7-a0f6-4d27a45071e0 is going to be updated. [ 1082.999846] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.999995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.000060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.000329] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.000505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.000674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.189958] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 1083.190505] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a deletion is rescheduled due to dependency. [ 1083.190820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.191361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.191707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.192117] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.192489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.192489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.192737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.192930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.193121] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.695891] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.878981] env[62909]: INFO networking_nsxv3.common.synchronization [req-d25f3625-ada3-410c-9494-4310b815ed0b req-85e83c77-29ac-4dff-8ad3-e5de02996e63 tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1083.879638] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1083.879964] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.885266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.885266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.885266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.885266] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.885266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.885266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.885266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.885266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.885266] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.944147] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1083.944147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.944147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.944147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.944147] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.944147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.944147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.944147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.944147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.944147] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.944147] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.197791] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.386252] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.446681] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.446681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.446681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.446681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.446962] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.446962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.446962] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.447100] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.447100] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.447191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.447335] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.447429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.447490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.447628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.447762] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.447850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.447908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.448050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.448124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.448201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.448287] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.699273] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 in Status: SUCCESS [ 1084.699638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.700175] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.700368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.700516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.700847] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.701013] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.701188] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 1084.734978] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.735202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.735266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.735565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.735790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.747261] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 1084.888391] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.950105] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00039edf-d86f-462e-a706-bad2d411b887: rpc.has_security_group_logging(os_id): False [ 1084.972662] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.972893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.972893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.973218] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.973358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.973899] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.973899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.973899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.974172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.974232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.974419] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.974519] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.974575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.974723] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.974795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.974988] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.975148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.975259] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.975401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.975467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.975566] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1085.052517] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.052517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1085.052517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.052817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.052817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1085.069898] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1085.390990] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.391201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1085.391240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.391558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.391757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1085.391814] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1085.433407] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.434606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1085.434606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.434606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.434964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1085.447960] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1086.773998] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 1086.774386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.774692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.774822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.775072] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.775192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.775289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.775479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.775558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.775644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.775739] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.090757] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1087.090993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.279948] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.461071] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1087.461880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.782121] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23297eee-5815-4160-b6ed-90818fa0ab3a: rpc.has_security_group_logging(os_id): False [ 1087.802270] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.802563] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.802563] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.802811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.802878] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.803149] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.803255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.803305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.803683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.803683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.803683] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 1087.872863] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.873017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.873096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.873303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.873467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.886596] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 1088.880578] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1088.880980] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1089.902107] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 1089.902374] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.049922] env[62909]: INFO networking_nsxv3.common.synchronization [req-89883712-de45-482a-be50-94b55d7f5af3 req-844ecfee-4f83-429d-8f3e-e760baae62ad tempest-InstanceActionsV221TestJSON-11607536 tempest-InstanceActionsV221TestJSON-11607536-project-member] Enqueued Resource ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c with Priority: HIGHEST for action security_group_members [ 1090.049922] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c with Priority: HIGHEST for action security_group_members [ 1090.049922] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.049922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.049922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.049922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.051197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.051509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.051699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.051993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.052283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.052567] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5ae12c5-b5af-4b41-a61b-4088bef35c7c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.381040] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.381194] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-315" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.382063] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-315" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.382063] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-315" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.382063] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.382063] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.382335] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.382395] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.382661] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.382886] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.383010] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.383126] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.383236] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.383349] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.383455] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.383590] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.404251] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.404251] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1090.404251] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.404636] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-315" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.404922] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-926aebc2-7c6b-4107-a2a5-e496438a84db taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.405173] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-926aebc2-7c6b-4107-a2a5-e496438a84db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.405333] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-926aebc2-7c6b-4107-a2a5-e496438a84db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.405718] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-926aebc2-7c6b-4107-a2a5-e496438a84db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.405878] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('926aebc2-7c6b-4107-a2a5-e496438a84db',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.557268] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.557268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.557268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.557268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.557268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.557268] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.557268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.557268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.557268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.557268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.557268] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c already deleted. [ 1090.557268] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.909084] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.909505] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.909568] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.909957] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.910045] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.910227] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 926aebc2-7c6b-4107-a2a5-e496438a84db not found, creating... [ 1090.910562] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.910735] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.910860] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.911125] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.911271] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.911577] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.911911] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.911911] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.912079] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.912216] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.912361] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 926aebc2-7c6b-4107-a2a5-e496438a84db is going to be created. [ 1090.941565] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.941789] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.941789] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.942085] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.942328] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.942612] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-926aebc2-7c6b-4107-a2a5-e496438a84db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.266115] env[62909]: INFO networking_nsxv3.common.synchronization [req-89883712-de45-482a-be50-94b55d7f5af3 req-d71c2963-12ed-487a-95ad-7b0f853ce468 service nova] Enqueued Resource ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c with Priority: HIGHEST for action security_group_rules [ 1092.266115] env[62909]: INFO networking_nsxv3.common.synchronization [req-89883712-de45-482a-be50-94b55d7f5af3 req-d71c2963-12ed-487a-95ad-7b0f853ce468 service nova] Enqueued Resource ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c with Priority: HIGHEST for action security_group_members [ 1092.266115] env[62909]: INFO networking_nsxv3.common.synchronization [req-89883712-de45-482a-be50-94b55d7f5af3 req-d71c2963-12ed-487a-95ad-7b0f853ce468 service nova] Enqueued Resource ID: 926aebc2-7c6b-4107-a2a5-e496438a84db with Priority: HIGHEST for action port [ 1092.266115] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c with Priority: HIGHEST for action security_group_rules [ 1092.266115] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c with Priority: HIGHEST for action security_group_members [ 1092.266115] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 926aebc2-7c6b-4107-a2a5-e496438a84db with Priority: HIGHEST for action port [ 1092.266115] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5ae12c5-b5af-4b41-a61b-4088bef35c7c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.266115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.266115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.267763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.267861] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5ae12c5-b5af-4b41-a61b-4088bef35c7c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.268696] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.268813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.268907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.269092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.269239] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.269328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.269386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.269524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.269605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.269690] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5ae12c5-b5af-4b41-a61b-4088bef35c7c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.270423] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-926aebc2-7c6b-4107-a2a5-e496438a84db taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.270609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-926aebc2-7c6b-4107-a2a5-e496438a84db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.270609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-926aebc2-7c6b-4107-a2a5-e496438a84db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.270719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-926aebc2-7c6b-4107-a2a5-e496438a84db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.270783] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('926aebc2-7c6b-4107-a2a5-e496438a84db',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.772059] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.774210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.774210] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5ae12c5-b5af-4b41-a61b-4088bef35c7c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.774210] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 926aebc2-7c6b-4107-a2a5-e496438a84db with status ACTIVE [ 1092.774210] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.774210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.774210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.774210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.774515] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.774515] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.774649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.774649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.774799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.774954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.775258] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.775258] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.775364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.775441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.775507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.776073] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 926aebc2-7c6b-4107-a2a5-e496438a84db is going to be updated. [ 1092.801828] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.801977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1092.802092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.802478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1092.802478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.802590] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-926aebc2-7c6b-4107-a2a5-e496438a84db" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.248695] env[62909]: INFO networking_nsxv3.common.synchronization [req-a9e771cd-8c7b-418d-a2bd-89c2bfec80e9 req-46a147f1-9d51-4538-b471-ef22ad37eda9 tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1093.248695] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1093.249028] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.249874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.249874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.249874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.249874] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.249874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.249874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.250232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.250314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.250766] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.277523] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5ae12c5-b5af-4b41-a61b-4088bef35c7c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.755941] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.755941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.755941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.755941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.755941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.755941] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.755941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.755941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.755941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.755941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.755941] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1093.784033] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.784033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.784033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.784033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.784033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.784033] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c is going to be created. [ 1093.792780] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.792780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.792780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.792780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.792780] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.802394] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1093.813247] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.813247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.813247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.813247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.813247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.827023] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c in Status: UNINITIALIZED for 2s [ 1094.647123] env[62909]: INFO networking_nsxv3.common.synchronization [req-77e29fe3-d822-41ca-b588-2c3e30773408 req-9977f4e4-e4d4-4a0e-aee5-7b018497dadc tempest-ImagesOneServerNegativeTestJSON-373251561 tempest-ImagesOneServerNegativeTestJSON-373251561-project-member] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1094.647123] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1094.647123] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.647123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1094.647123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.648243] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1094.648545] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.648863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1094.649142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.649399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1094.649893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1094.650114] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.152837] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.153010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.153169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.153304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.153394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.153731] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.153822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.153894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.154110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.154202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.154293] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be updated. [ 1095.176321] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.176540] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.176689] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.176975] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.179124] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.179124] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.179124] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.179328] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.179562] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.179825] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1095.179985] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.180175] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.183058] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.183058] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1095.183058] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.183058] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.183415] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.183495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.183562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.183777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.183903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.195624] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: IN_PROGRESS for 2s [ 1095.206017] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.206017] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1095.206017] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.206017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-779" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.206017] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-e597807d-27f1-4d23-b472-414faeba65a8 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.206017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-e597807d-27f1-4d23-b472-414faeba65a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.206017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-e597807d-27f1-4d23-b472-414faeba65a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.206017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-e597807d-27f1-4d23-b472-414faeba65a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.206017] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e597807d-27f1-4d23-b472-414faeba65a8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.437075] env[62909]: INFO networking_nsxv3.common.synchronization [None req-0033084f-9dfb-40c5-ba5f-e3934cd1397a None None] Enqueued Resource ID: f48ac47f-3211-4516-97cc-b7a9fb542d87 with Priority: HIGHEST for action port [ 1095.437623] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48ac47f-3211-4516-97cc-b7a9fb542d87 with Priority: HIGHEST for action port [ 1095.437930] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-f48ac47f-3211-4516-97cc-b7a9fb542d87 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.438167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f48ac47f-3211-4516-97cc-b7a9fb542d87" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.438261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f48ac47f-3211-4516-97cc-b7a9fb542d87" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.438523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f48ac47f-3211-4516-97cc-b7a9fb542d87" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.438608] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f48ac47f-3211-4516-97cc-b7a9fb542d87',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.708222] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.712307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.712307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.712307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.712307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.712307] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port e597807d-27f1-4d23-b472-414faeba65a8 not found, creating... [ 1095.712307] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.712307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.712307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.712307] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.714810] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.715177] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.715372] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.715497] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.715752] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.715901] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.716195] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: e597807d-27f1-4d23-b472-414faeba65a8 is going to be created. [ 1095.741491] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.741863] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.742058] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.742578] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.742894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.747023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-e597807d-27f1-4d23-b472-414faeba65a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.815491] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1095.815797] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 1095.815884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.852084] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c in Status: SUCCESS [ 1095.852358] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.853077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.853077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.853077] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.853382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.853382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.853441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.853609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.853609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.853728] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5ae12c5-b5af-4b41-a61b-4088bef35c7c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.941447] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f48ac47f-3211-4516-97cc-b7a9fb542d87 [ 1095.941698] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.942315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.942315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.942315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.942315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.942534] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f48ac47f-3211-4516-97cc-b7a9fb542d87 already deleted. [ 1095.942534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f48ac47f-3211-4516-97cc-b7a9fb542d87" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.358797] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.359247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.359325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.359530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.359729] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.359841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.359931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.360105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.360195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.360307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.360463] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.360555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.360659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.360952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.361048] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.361108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.361186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.361356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.361403] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.361483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.361595] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5ae12c5-b5af-4b41-a61b-4088bef35c7c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.753041] env[62909]: INFO networking_nsxv3.common.synchronization [req-77e29fe3-d822-41ca-b588-2c3e30773408 req-e8e671c2-d787-4816-af9a-3f869d41817d service nova] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_rules [ 1096.753332] env[62909]: INFO networking_nsxv3.common.synchronization [req-77e29fe3-d822-41ca-b588-2c3e30773408 req-e8e671c2-d787-4816-af9a-3f869d41817d service nova] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1096.753400] env[62909]: INFO networking_nsxv3.common.synchronization [req-77e29fe3-d822-41ca-b588-2c3e30773408 req-e8e671c2-d787-4816-af9a-3f869d41817d service nova] Enqueued Resource ID: e597807d-27f1-4d23-b472-414faeba65a8 with Priority: HIGHEST for action port [ 1096.753639] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_rules [ 1096.753769] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1096.753863] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e597807d-27f1-4d23-b472-414faeba65a8 with Priority: HIGHEST for action port [ 1096.754433] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.754566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.754637] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.756377] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.756487] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.759494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.759494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.759494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-e597807d-27f1-4d23-b472-414faeba65a8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.759494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e597807d-27f1-4d23-b472-414faeba65a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.759494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e597807d-27f1-4d23-b472-414faeba65a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.759494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e597807d-27f1-4d23-b472-414faeba65a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.759494] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e597807d-27f1-4d23-b472-414faeba65a8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.864415] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5ae12c5-b5af-4b41-a61b-4088bef35c7c: rpc.has_security_group_logging(os_id): False [ 1096.884364] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.884569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.884569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.884770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.884861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.885080] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.885449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.885902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.886255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.886255] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.886424] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.886523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.886587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.886750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.886826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.887052] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.887150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.887209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.887345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.887427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.887498] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c is going to be created. [ 1096.974031] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.974031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.974289] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.974439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.974699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.995996] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c in Status: IN_PROGRESS for 2s [ 1097.209927] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: SUCCESS [ 1097.210136] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc deletion is rescheduled due to dependency. [ 1097.210381] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.210442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.210735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.210920] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.211048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.211106] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.211320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.211409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.211508] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.260017] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.260172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.261770] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e597807d-27f1-4d23-b472-414faeba65a8 with status ACTIVE [ 1097.261966] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.262097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.262159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.262368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.262455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.262685] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.262793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.262849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.263013] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.263085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.263270] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.263432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.263432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.263568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.263696] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.263744] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e597807d-27f1-4d23-b472-414faeba65a8 is going to be updated. [ 1097.287983] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.288226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.288226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.288438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.288568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.288730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e597807d-27f1-4d23-b472-414faeba65a8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.364323] env[62909]: INFO networking_nsxv3.common.synchronization [None req-29ee3909-5a3e-4e1e-859f-a7e8af03f6ff None None] Enqueued Resource ID: b8f6c680-5e03-4aed-bf70-91549d2b1712 with Priority: HIGHEST for action port [ 1097.364888] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f6c680-5e03-4aed-bf70-91549d2b1712 with Priority: HIGHEST for action port [ 1097.365879] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8f6c680-5e03-4aed-bf70-91549d2b1712 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.365879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8f6c680-5e03-4aed-bf70-91549d2b1712" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.365879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8f6c680-5e03-4aed-bf70-91549d2b1712" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.365879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8f6c680-5e03-4aed-bf70-91549d2b1712" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.365879] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8f6c680-5e03-4aed-bf70-91549d2b1712',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.714157] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.870741] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8f6c680-5e03-4aed-bf70-91549d2b1712 [ 1097.870741] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.870741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.870741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.870741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.870741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.870741] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8f6c680-5e03-4aed-bf70-91549d2b1712 already deleted. [ 1097.870741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8f6c680-5e03-4aed-bf70-91549d2b1712" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.881062] env[62909]: INFO networking_nsxv3.common.synchronization [req-d3146bdb-305d-47a7-864a-e5a0c1bde1b5 req-fc3fe947-6ef0-4b76-858d-0f6a9db42450 tempest-ServerActionsV293TestJSON-301243714 tempest-ServerActionsV293TestJSON-301243714-project-member] Enqueued Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_members [ 1097.881611] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_members [ 1097.881933] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.886185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.886185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.886379] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.886451] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.886556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.886640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.886781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.886885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.887103] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.216396] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.377439] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.377665] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-909" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.377805] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-909" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.378128] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-909" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.378399] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.378560] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.378684] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.378907] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.379064] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.379274] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.379388] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.379498] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.379606] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.379716] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.379824] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.379957] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.392999] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.393164] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.393233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.393438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.393526] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.393764] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.393872] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.393938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.394105] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.394181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.394268] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 already deleted. [ 1098.394347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.401237] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.401406] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1098.401542] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.401707] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-909" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.402013] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-3724af6c-0dc9-4056-9f6c-d5d8f85f195e taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.402194] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-3724af6c-0dc9-4056-9f6c-d5d8f85f195e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.402316] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-3724af6c-0dc9-4056-9f6c-d5d8f85f195e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.402616] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-3724af6c-0dc9-4056-9f6c-d5d8f85f195e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.402784] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3724af6c-0dc9-4056-9f6c-d5d8f85f195e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.723023] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.723243] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.723340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.723551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.723643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.723749] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be updated. [ 1098.754568] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.754764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.754764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.754922] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.755082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.763576] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: IN_PROGRESS for 2s [ 1098.905140] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.905476] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.905591] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.905879] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.906065] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.906243] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 3724af6c-0dc9-4056-9f6c-d5d8f85f195e not found, creating... [ 1098.906542] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.906728] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.906854] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.907107] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.907254] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.907548] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.907710] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.907827] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.908055] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.908266] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.908432] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 3724af6c-0dc9-4056-9f6c-d5d8f85f195e is going to be created. [ 1098.933554] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.933791] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.933936] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.934245] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.934482] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.934754] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-3724af6c-0dc9-4056-9f6c-d5d8f85f195e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.009638] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c in Status: SUCCESS [ 1099.009953] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.890669] env[62909]: INFO networking_nsxv3.common.synchronization [req-d3146bdb-305d-47a7-864a-e5a0c1bde1b5 req-a31b366b-fef3-493a-88bb-d63ce01283ff service nova] Enqueued Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_rules [ 1099.890669] env[62909]: INFO networking_nsxv3.common.synchronization [req-d3146bdb-305d-47a7-864a-e5a0c1bde1b5 req-a31b366b-fef3-493a-88bb-d63ce01283ff service nova] Enqueued Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_members [ 1099.890669] env[62909]: INFO networking_nsxv3.common.synchronization [req-d3146bdb-305d-47a7-864a-e5a0c1bde1b5 req-a31b366b-fef3-493a-88bb-d63ce01283ff service nova] Enqueued Resource ID: 3724af6c-0dc9-4056-9f6c-d5d8f85f195e with Priority: HIGHEST for action port [ 1099.890669] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_rules [ 1099.890669] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_members [ 1099.890669] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3724af6c-0dc9-4056-9f6c-d5d8f85f195e with Priority: HIGHEST for action port [ 1099.890669] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.890669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.890669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.890669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.890669] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.891252] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.891252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.891252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.891252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.891252] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.891568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.891568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.891568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.891568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.891785] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.892388] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-3724af6c-0dc9-4056-9f6c-d5d8f85f195e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.892587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3724af6c-0dc9-4056-9f6c-d5d8f85f195e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.892587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3724af6c-0dc9-4056-9f6c-d5d8f85f195e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.893160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3724af6c-0dc9-4056-9f6c-d5d8f85f195e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.893160] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3724af6c-0dc9-4056-9f6c-d5d8f85f195e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.396546] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.396898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.396937] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.398841] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3724af6c-0dc9-4056-9f6c-d5d8f85f195e with status ACTIVE [ 1100.398841] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.398841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.399058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.399154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.399198] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.399647] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.399647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.399647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.399803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.399803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.400023] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.400023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.400213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.400213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.400304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.400348] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3724af6c-0dc9-4056-9f6c-d5d8f85f195e is going to be updated. [ 1100.425747] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.426773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.426773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.426773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.426955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.427192] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3724af6c-0dc9-4056-9f6c-d5d8f85f195e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.775322] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: SUCCESS [ 1100.775567] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.775779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.776043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.776265] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.776401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.776486] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.776668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.778028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.778028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.778028] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.902312] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.280177] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.280352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.280425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.280644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.280890] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.280993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.281070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.281249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.281359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.281573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.281573] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.281685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.281716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.282232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.282232] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.282232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.282232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.282409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.282438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.282511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.282596] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.404633] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.405023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.405023] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.405121] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.405163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.405282] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 is going to be created. [ 1101.442333] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.442537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.442657] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.443014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.443449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.462724] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 in Status: UNINITIALIZED for 2s [ 1101.785141] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc: rpc.has_security_group_logging(os_id): False [ 1101.805213] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.805434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.805434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.805661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.805759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.806075] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.806227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.806301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.806465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.806543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.806768] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.806866] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.806928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.807098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.807172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.807351] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.807443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.807515] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.807651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.807727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.807814] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be updated. [ 1101.888896] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.889246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.889400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.889819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.890267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.923877] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: IN_PROGRESS for 2s [ 1102.283154] env[62909]: INFO networking_nsxv3.common.synchronization [req-d382d78a-0dea-4216-bdf3-1f0a7b5b1409 req-72f4a5c3-bed1-4c54-b119-bcc434e75c86 tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1102.288952] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1102.291903] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.292175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.292307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.292984] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.293109] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.294490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.294579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.294965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.294965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.295182] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.803354] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.937050] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.937268] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.937657] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.937657] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.937985] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.938113] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.938224] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.938454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.938623] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.938971] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.939626] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.939626] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.939626] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.939773] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.939806] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.940047] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.973028] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.973028] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1102.973253] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.973346] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.973832] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-7cfd599e-0580-46fa-95e7-a1412897fede taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.974597] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-7cfd599e-0580-46fa-95e7-a1412897fede" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.974873] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-7cfd599e-0580-46fa-95e7-a1412897fede" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.975402] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-7cfd599e-0580-46fa-95e7-a1412897fede" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.975634] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cfd599e-0580-46fa-95e7-a1412897fede',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.305561] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.474886] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 in Status: SUCCESS [ 1103.475134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.475311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.475538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.475736] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.475979] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.475979] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.476088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.476149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.476252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.476383] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.482534] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.482534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.482534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.482534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.482534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.482534] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 7cfd599e-0580-46fa-95e7-a1412897fede not found, creating... [ 1103.482534] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.482534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.482534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.482534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.482534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.483046] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.483046] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.483046] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.483046] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.483046] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.483046] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 7cfd599e-0580-46fa-95e7-a1412897fede is going to be created. [ 1103.506694] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.507017] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.507546] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.507933] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.508338] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.512167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-7cfd599e-0580-46fa-95e7-a1412897fede" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.809116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.809516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.809516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.809516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.809610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.810233] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1103.843489] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.843489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.843489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.844213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.844213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.855319] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1103.949866] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: SUCCESS [ 1103.950304] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.979999] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.483148] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae3dd4dc-00bd-42c2-981b-37dceb5d7e41: rpc.has_security_group_logging(os_id): False [ 1104.509596] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.510506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.510506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.510506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.510506] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.510658] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.510749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.510791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.511034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.511091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.511133] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 is going to be created. [ 1104.578394] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.578782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.578782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.578981] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.579201] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.592370] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 in Status: IN_PROGRESS for 2s [ 1104.639330] env[62909]: INFO networking_nsxv3.common.synchronization [req-52625c5f-9025-416a-99da-e9e7086b6ebc req-67fd9720-38d5-4bc9-abbb-e254fa5ef9f5 tempest-ServerMetadataNegativeTestJSON-311831323 tempest-ServerMetadataNegativeTestJSON-311831323-project-member] Enqueued Resource ID: 82fed768-4b8f-4414-99cd-373f9e532647 with Priority: HIGHEST for action security_group_members [ 1104.639975] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82fed768-4b8f-4414-99cd-373f9e532647 with Priority: HIGHEST for action security_group_members [ 1104.640788] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-82fed768-4b8f-4414-99cd-373f9e532647 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.640951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.645125] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.645485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.645710] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.645892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.645961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.646165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.646283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.646511] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82fed768-4b8f-4414-99cd-373f9e532647',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.660506] env[62909]: INFO networking_nsxv3.common.synchronization [req-d382d78a-0dea-4216-bdf3-1f0a7b5b1409 req-dfa08c56-c7ef-42ef-b089-24f173d8fc5c service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 1104.660732] env[62909]: INFO networking_nsxv3.common.synchronization [req-d382d78a-0dea-4216-bdf3-1f0a7b5b1409 req-dfa08c56-c7ef-42ef-b089-24f173d8fc5c service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1104.660909] env[62909]: INFO networking_nsxv3.common.synchronization [req-d382d78a-0dea-4216-bdf3-1f0a7b5b1409 req-dfa08c56-c7ef-42ef-b089-24f173d8fc5c service nova] Enqueued Resource ID: 7cfd599e-0580-46fa-95e7-a1412897fede with Priority: HIGHEST for action port [ 1104.661972] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 1104.662142] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1104.662246] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cfd599e-0580-46fa-95e7-a1412897fede with Priority: HIGHEST for action port [ 1104.662561] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.662693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.662802] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.663053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.663150] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.665047] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.665197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.665395] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cfd599e-0580-46fa-95e7-a1412897fede taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.665502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cfd599e-0580-46fa-95e7-a1412897fede" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.665570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cfd599e-0580-46fa-95e7-a1412897fede" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.665776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cfd599e-0580-46fa-95e7-a1412897fede" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.665858] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cfd599e-0580-46fa-95e7-a1412897fede',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.966890] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.967239] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-314" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.967367] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-314" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.967584] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-314" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.967895] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.968039] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.968192] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.968461] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.968654] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.968876] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.968999] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.969125] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.969240] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.969356] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.969467] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.969602] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.997418] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.997418] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.997418] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.997418] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-314" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.997561] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-9493c2a8-67b9-476a-b101-494b5cab84b3 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.997753] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-9493c2a8-67b9-476a-b101-494b5cab84b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.997976] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-9493c2a8-67b9-476a-b101-494b5cab84b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.998287] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-9493c2a8-67b9-476a-b101-494b5cab84b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.998434] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9493c2a8-67b9-476a-b101-494b5cab84b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.148887] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.149087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.149163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.149388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.149480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.149709] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.149793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.149834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.149989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.150079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.150169] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82fed768-4b8f-4414-99cd-373f9e532647 already deleted. [ 1105.150249] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.168119] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.168303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.168606] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cfd599e-0580-46fa-95e7-a1412897fede with status ACTIVE [ 1105.168805] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.168946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.169026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.169292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.169382] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.169586] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.169692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.169749] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.169921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.169997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.170202] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.170300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.170359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.170496] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.170570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.170684] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cfd599e-0580-46fa-95e7-a1412897fede is going to be updated. [ 1105.194019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.194368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.194557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.194906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.195231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.195529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cfd599e-0580-46fa-95e7-a1412897fede" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.500926] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.501195] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.501336] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.501617] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.501772] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.501931] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 9493c2a8-67b9-476a-b101-494b5cab84b3 not found, creating... [ 1105.502248] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.502412] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.502534] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.502795] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.502946] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.503259] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.503421] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.503541] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.503771] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.503903] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.504281] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 9493c2a8-67b9-476a-b101-494b5cab84b3 is going to be created. [ 1105.531847] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.532189] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.532412] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.532802] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.533132] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.533473] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-9493c2a8-67b9-476a-b101-494b5cab84b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.667211] env[62909]: INFO networking_nsxv3.common.synchronization [req-2d88ff48-908f-4af0-84e7-e010acc03efc req-60902f9b-7cd3-4bca-9565-4a5f6472e1fe tempest-InstanceActionsV221TestJSON-11607536 tempest-InstanceActionsV221TestJSON-11607536-project-member] Enqueued Resource ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c with Priority: HIGHEST for action security_group_members [ 1105.670094] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c with Priority: HIGHEST for action security_group_members [ 1105.670094] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.670094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.670094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.670094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.670094] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.670420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.670420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.670420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.670639] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.670639] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5ae12c5-b5af-4b41-a61b-4088bef35c7c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.866676] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1105.867077] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.867344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.867664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.867980] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.868141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.868209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.868378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.868463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.868561] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.172491] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.173149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.173149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.173149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.173149] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.173806] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.173806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.173806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.173806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.173806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.173806] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c is going to be updated. [ 1106.209133] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.209412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.209540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.209917] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.210303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.224789] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c in Status: IN_PROGRESS for 2s [ 1106.344471] env[62909]: INFO networking_nsxv3.common.synchronization [req-52625c5f-9025-416a-99da-e9e7086b6ebc req-78e9fef4-ddf8-48ee-9cf5-e9dd831cd667 service nova] Enqueued Resource ID: 82fed768-4b8f-4414-99cd-373f9e532647 with Priority: HIGHEST for action security_group_rules [ 1106.344471] env[62909]: INFO networking_nsxv3.common.synchronization [req-52625c5f-9025-416a-99da-e9e7086b6ebc req-78e9fef4-ddf8-48ee-9cf5-e9dd831cd667 service nova] Enqueued Resource ID: 82fed768-4b8f-4414-99cd-373f9e532647 with Priority: HIGHEST for action security_group_members [ 1106.344471] env[62909]: INFO networking_nsxv3.common.synchronization [req-52625c5f-9025-416a-99da-e9e7086b6ebc req-78e9fef4-ddf8-48ee-9cf5-e9dd831cd667 service nova] Enqueued Resource ID: 9493c2a8-67b9-476a-b101-494b5cab84b3 with Priority: HIGHEST for action port [ 1106.344471] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82fed768-4b8f-4414-99cd-373f9e532647 with Priority: HIGHEST for action security_group_rules [ 1106.344471] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82fed768-4b8f-4414-99cd-373f9e532647 with Priority: HIGHEST for action security_group_members [ 1106.344471] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9493c2a8-67b9-476a-b101-494b5cab84b3 with Priority: HIGHEST for action port [ 1106.344471] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82fed768-4b8f-4414-99cd-373f9e532647 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.344471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.345309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.345704] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.345947] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82fed768-4b8f-4414-99cd-373f9e532647',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.347268] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-82fed768-4b8f-4414-99cd-373f9e532647 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.347336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.347431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.347654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.347850] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.348016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.348093] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.349134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.349134] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.349134] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82fed768-4b8f-4414-99cd-373f9e532647',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.349705] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-9493c2a8-67b9-476a-b101-494b5cab84b3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.349834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9493c2a8-67b9-476a-b101-494b5cab84b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.349969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9493c2a8-67b9-476a-b101-494b5cab84b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.350032] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9493c2a8-67b9-476a-b101-494b5cab84b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.350108] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9493c2a8-67b9-476a-b101-494b5cab84b3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.370680] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.609340] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 in Status: SUCCESS [ 1106.609554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.851445] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-82fed768-4b8f-4414-99cd-373f9e532647 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.851591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.851872] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82fed768-4b8f-4414-99cd-373f9e532647',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.852903] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9493c2a8-67b9-476a-b101-494b5cab84b3 with status ACTIVE [ 1106.853201] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.853285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.853285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.853501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.853598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.853842] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.853937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.853937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.854311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.854311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.854443] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.854514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.854562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.854681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.854811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.854811] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9493c2a8-67b9-476a-b101-494b5cab84b3 is going to be updated. [ 1106.873831] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.880322] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.880417] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.880467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.880661] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.880901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.881067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9493c2a8-67b9-476a-b101-494b5cab84b3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.174638] env[62909]: INFO networking_nsxv3.common.synchronization [req-fd6aa1a3-2257-472e-bec9-6a741e765eac req-06be830b-70f1-46de-a745-075c244fc0bc tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1107.175265] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1107.175592] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.175804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.175877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.176171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.176630] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.176630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.176630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.176630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.176806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.176806] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.358634] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82fed768-4b8f-4414-99cd-373f9e532647',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.376054] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.376054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.376054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.376439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.376439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.376439] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1107.439648] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.439932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.439932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.440094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.440498] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.456246] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1107.537482] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.537678] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.537997] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.538104] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.538347] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.538509] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.538628] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.538847] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.539292] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.541905] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.542762] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.542945] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.543088] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.543220] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.543334] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.543478] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.576692] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.576692] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1107.576692] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.576692] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.576692] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-629efcb6-6e27-4b06-99d0-469216825a32 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.576692] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-629efcb6-6e27-4b06-99d0-469216825a32" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.576692] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-629efcb6-6e27-4b06-99d0-469216825a32" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.576692] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-629efcb6-6e27-4b06-99d0-469216825a32" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.576692] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('629efcb6-6e27-4b06-99d0-469216825a32',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.683310] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.683310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.683310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.683310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.683310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.683310] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.683310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.683310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.683310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.683310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.683310] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1107.709760] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.711439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.711439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.711439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.711621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.721852] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1107.865993] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.866159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.866251] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.866660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.866660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.866861] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82fed768-4b8f-4414-99cd-373f9e532647 is going to be created. [ 1107.893197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.893420] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.893508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.893797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.894085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.908961] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82fed768-4b8f-4414-99cd-373f9e532647 in Status: UNINITIALIZED for 2s [ 1107.953510] env[62909]: INFO networking_nsxv3.common.synchronization [req-f56be800-03ab-4595-9134-938a85a79b0b req-228e431b-eea0-432c-8cc6-0324ac82c359 tempest-ImagesOneServerNegativeTestJSON-373251561 tempest-ImagesOneServerNegativeTestJSON-373251561-project-member] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1107.954368] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGHEST for action security_group_members [ 1107.955324] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.955455] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.955516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.955731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.958139] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.958139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.958139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.958139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.958139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.958139] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.078809] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.079591] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.079591] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.079694] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.079888] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.080148] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 629efcb6-6e27-4b06-99d0-469216825a32 not found, creating... [ 1108.080498] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.080754] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.080894] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.081210] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.082173] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.082173] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.082173] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.086095] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.086451] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.086613] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.086776] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 629efcb6-6e27-4b06-99d0-469216825a32 is going to be created. [ 1108.157291] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.157291] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.157291] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.157492] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.157688] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.157919] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-629efcb6-6e27-4b06-99d0-469216825a32" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.239295] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c in Status: SUCCESS [ 1108.239630] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c deletion is rescheduled due to dependency. [ 1108.239671] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.458880] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.459075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.459173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.459508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.459735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.459968] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.461948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.461948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.461948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.461948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.461948] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be updated. [ 1108.493996] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.494189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.494264] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.494493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.494642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.506724] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: IN_PROGRESS for 2s [ 1108.938680] env[62909]: INFO networking_nsxv3.common.synchronization [req-fd6aa1a3-2257-472e-bec9-6a741e765eac req-4731ea07-a85b-4e3f-9695-bc99e1fc2c85 service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 1108.939021] env[62909]: INFO networking_nsxv3.common.synchronization [req-fd6aa1a3-2257-472e-bec9-6a741e765eac req-4731ea07-a85b-4e3f-9695-bc99e1fc2c85 service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1108.939195] env[62909]: INFO networking_nsxv3.common.synchronization [req-fd6aa1a3-2257-472e-bec9-6a741e765eac req-4731ea07-a85b-4e3f-9695-bc99e1fc2c85 service nova] Enqueued Resource ID: 629efcb6-6e27-4b06-99d0-469216825a32 with Priority: HIGHEST for action port [ 1108.939823] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 1108.940104] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1108.940104] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 629efcb6-6e27-4b06-99d0-469216825a32 with Priority: HIGHEST for action port [ 1108.940422] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.940545] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.940622] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.940901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.941016] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.945763] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.946013] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.946149] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-629efcb6-6e27-4b06-99d0-469216825a32 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.946227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-629efcb6-6e27-4b06-99d0-469216825a32" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.946227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-629efcb6-6e27-4b06-99d0-469216825a32" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.950101] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-629efcb6-6e27-4b06-99d0-469216825a32" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.950101] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('629efcb6-6e27-4b06-99d0-469216825a32',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.450062] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.450062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.450062] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 629efcb6-6e27-4b06-99d0-469216825a32 with status ACTIVE [ 1109.450624] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.450624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.450624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.450624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.450624] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.450903] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.451038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.451038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.451336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.451336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.451457] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.451557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.451626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.451798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.451871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.451956] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 629efcb6-6e27-4b06-99d0-469216825a32 is going to be updated. [ 1109.466440] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1109.466654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.466864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.467146] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.467375] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.467507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.467571] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.467756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.467862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.467972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.468095] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.479888] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.480102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.480150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.480478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.480478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.480638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-629efcb6-6e27-4b06-99d0-469216825a32" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.734070] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1109.734264] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 1109.734480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.734663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.734910] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.735481] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.735481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.735481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.735481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.735796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.735796] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.921128] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82fed768-4b8f-4414-99cd-373f9e532647 in Status: SUCCESS [ 1109.921389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.922715] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.922867] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.923371] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.924212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.924368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.924682] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.925693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.926154] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.926325] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82fed768-4b8f-4414-99cd-373f9e532647',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.973548] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.973742] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.973792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.974072] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.974258] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.974356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.974446] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.974583] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.974675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.974753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.974916] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.974995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.975064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.975239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.975380] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.975471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.975530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.975663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.975739] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.975821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.975909] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.239018] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.429586] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-82fed768-4b8f-4414-99cd-373f9e532647 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.429770] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.429889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.430101] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.430288] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.430405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.430480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.430654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.430745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.430845] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.431042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-82fed768-4b8f-4414-99cd-373f9e532647 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.431168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.431226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.431394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.431554] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.431659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.431729] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.431860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.431936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.432025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.432114] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82fed768-4b8f-4414-99cd-373f9e532647',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.478239] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57568fd4-ee2b-43e3-a228-9a168490f0f5: rpc.has_security_group_logging(os_id): False [ 1110.498733] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.498948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.499078] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.499418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.499511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.499835] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.500079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.500136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.500395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.500468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.500758] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.500906] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.501020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.501245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.501366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.501639] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.501791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.501897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.502127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.502250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.502382] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1110.515288] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc in Status: SUCCESS [ 1110.515517] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc deletion is rescheduled due to dependency. [ 1110.515667] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.573538] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.573721] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.573779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.574159] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.574324] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.589704] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1110.741075] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.934865] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82fed768-4b8f-4414-99cd-373f9e532647: rpc.has_security_group_logging(os_id): False [ 1110.955719] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.955924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.955924] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.956150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.956278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.956427] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.956528] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.956607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.956773] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.956850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.957041] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.957137] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.957199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.957338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.957411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.957604] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.957695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.957755] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.957890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.957963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.958060] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82fed768-4b8f-4414-99cd-373f9e532647 is going to be created. [ 1111.030717] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.030938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.031054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.031233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.031426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.047129] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82fed768-4b8f-4414-99cd-373f9e532647 in Status: IN_PROGRESS for 2s [ 1111.244659] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.244914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.244990] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.245302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.245427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.246103] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1111.286081] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.286317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.286317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.286635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.286794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.300317] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1111.630795] env[62909]: INFO networking_nsxv3.common.synchronization [req-7961c763-155d-4825-8fef-7463909f4bdd req-324e0ce2-3562-44a8-b092-ca543c91a9b8 tempest-ServersNegativeTestJSON-170677023 tempest-ServersNegativeTestJSON-170677023-project-member] Enqueued Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 1111.631503] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd with Priority: HIGHEST for action security_group_members [ 1111.631868] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f28a45c0-8394-4cec-b3b7-949be46fb2dd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.631993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.637793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.637793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.637793] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.637793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.637793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.637793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.637793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.637793] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f28a45c0-8394-4cec-b3b7-949be46fb2dd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.141522] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.141522] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.141747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.141964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.142202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1112.142313] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.142415] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.142478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.142650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.142730] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1112.142877] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd is going to be updated. [ 1112.178273] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.178423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.178494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.178709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.178851] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1112.188056] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: IN_PROGRESS for 2s [ 1112.623653] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1112.623653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.082531] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82fed768-4b8f-4414-99cd-373f9e532647 in Status: SUCCESS [ 1113.082919] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.312513] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1113.312789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.313058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.313360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.313494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.313616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.313679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.313841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.314050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.314189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.314383] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.816997] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.818016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.818016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.818016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.818016] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.818016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.818016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.818311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.818311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.818311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.818539] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.818639] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.818722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.818895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.819088] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.819158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.819204] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.819362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.819423] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.819510] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.819620] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.204163] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd in Status: SUCCESS [ 1114.204163] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f28a45c0-8394-4cec-b3b7-949be46fb2dd deletion is rescheduled due to dependency. [ 1114.204163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f28a45c0-8394-4cec-b3b7-949be46fb2dd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.322225] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00039edf-d86f-462e-a706-bad2d411b887: rpc.has_security_group_logging(os_id): False [ 1114.340676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.340794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.340832] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.341171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.341262] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.341498] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.341598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.341662] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.341812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.341885] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.342124] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.342277] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.342277] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.342410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.342481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.342658] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.342751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.342816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.343009] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.343106] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.343210] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1114.419720] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.420442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.420442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.420442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.420442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.441776] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1116.464301] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1116.464691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.633741] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1116.633849] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1118.016197] env[62909]: INFO networking_nsxv3.common.synchronization [req-1334e005-7d0b-4c15-81e0-1584f2e57408 req-5a514304-6960-42f4-9c08-834186a29e88 tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1118.016772] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1118.017321] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.017441] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.017556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.017808] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.018042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.018178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.018287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.018534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.018683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.018858] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.521479] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.937051] env[62909]: INFO networking_nsxv3.common.synchronization [req-70ba0449-77db-4184-ad68-3957d4d3c871 req-8df9c7c8-b32e-47fd-af7a-915c60eb89fa tempest-ServerMetadataNegativeTestJSON-311831323 tempest-ServerMetadataNegativeTestJSON-311831323-project-member] Enqueued Resource ID: 82fed768-4b8f-4414-99cd-373f9e532647 with Priority: HIGHEST for action security_group_members [ 1118.937051] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82fed768-4b8f-4414-99cd-373f9e532647 with Priority: HIGHEST for action security_group_members [ 1118.937411] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-82fed768-4b8f-4414-99cd-373f9e532647 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.937530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.937656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.937902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.939133] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.939133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.939133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.939133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.939133] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.939133] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82fed768-4b8f-4414-99cd-373f9e532647',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.023410] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.444522] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.444703] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.444754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.444978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.445089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.445296] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.445396] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.445459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.445776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.445776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.445776] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82fed768-4b8f-4414-99cd-373f9e532647 is going to be updated. [ 1119.475293] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.475293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.475293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.475293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.476253] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.486560] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82fed768-4b8f-4414-99cd-373f9e532647 in Status: IN_PROGRESS for 2s [ 1119.526491] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.526670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.526717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.526942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.527042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.527150] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1119.560793] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.561053] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1119.561168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.561418] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1119.561588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1119.575850] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1120.635299] env[62909]: INFO networking_nsxv3.common.synchronization [None req-e6c74ee0-c46c-41b1-91e0-fa177c785888 None None] Enqueued Resource ID: 84162b2f-e38c-454e-85db-0da9e349a15e with Priority: HIGHEST for action port [ 1120.635629] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84162b2f-e38c-454e-85db-0da9e349a15e with Priority: HIGHEST for action port [ 1120.636169] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-84162b2f-e38c-454e-85db-0da9e349a15e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.636291] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84162b2f-e38c-454e-85db-0da9e349a15e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.636351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84162b2f-e38c-454e-85db-0da9e349a15e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.636606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84162b2f-e38c-454e-85db-0da9e349a15e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.636685] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84162b2f-e38c-454e-85db-0da9e349a15e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.142864] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84162b2f-e38c-454e-85db-0da9e349a15e [ 1121.142864] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.142864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.142864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.143124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.144033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.144033] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84162b2f-e38c-454e-85db-0da9e349a15e already deleted. [ 1121.144033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84162b2f-e38c-454e-85db-0da9e349a15e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.343968] env[62909]: INFO networking_nsxv3.common.synchronization [None req-a5ae3c3a-9a5c-4dfa-8a66-30649dda0e38 tempest-AttachVolumeTestJSON-255914310 tempest-AttachVolumeTestJSON-255914310-project-member] Enqueued Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_rules [ 1121.344643] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_rules [ 1121.345576] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.345889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.345889] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.346178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.346259] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.446636] env[62909]: INFO networking_nsxv3.common.synchronization [None req-eee6558d-57f5-46e2-844a-471badcc7adf tempest-AttachVolumeTestJSON-255914310 tempest-AttachVolumeTestJSON-255914310-project-member] Enqueued Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_rules [ 1121.447175] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_rules [ 1121.447477] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.447578] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.497123] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82fed768-4b8f-4414-99cd-373f9e532647 in Status: SUCCESS [ 1121.497386] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82fed768-4b8f-4414-99cd-373f9e532647 deletion is rescheduled due to dependency. [ 1121.497539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82fed768-4b8f-4414-99cd-373f9e532647" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.589113] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1121.589300] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.871272] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.871604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.871604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.871866] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.871972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.872087] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 already deleted. [ 1121.872193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.872352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.872532] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.872615] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.077080] env[62909]: INFO networking_nsxv3.common.synchronization [req-2cec7b37-dc0e-4982-9110-913c8147ebc0 req-b674569e-969a-4748-aef1-bd73b6c96a05 tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1122.077961] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1122.078189] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.079180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.079296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.080278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.080278] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.080278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.080278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.080480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.080517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.080613] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.396787] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.396894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.396961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.397231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.397322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.397425] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 already deleted. [ 1122.397534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.586537] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.586716] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.586799] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.587057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.587179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.587404] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.587512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.592317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.592317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.592317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.592317] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1122.619826] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.619826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.619826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.619826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.620226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.633064] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1123.185981] env[62909]: INFO networking_nsxv3.common.synchronization [None req-3d8f3ef5-3087-4392-8514-55c6582503eb None None] Enqueued Resource ID: 6a1cbe41-2f10-4f2a-a723-254ce17995ea with Priority: HIGHEST for action port [ 1123.185981] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a1cbe41-2f10-4f2a-a723-254ce17995ea with Priority: HIGHEST for action port [ 1123.186392] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a1cbe41-2f10-4f2a-a723-254ce17995ea taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.186392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a1cbe41-2f10-4f2a-a723-254ce17995ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.186392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a1cbe41-2f10-4f2a-a723-254ce17995ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.186654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a1cbe41-2f10-4f2a-a723-254ce17995ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.186801] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a1cbe41-2f10-4f2a-a723-254ce17995ea',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.688772] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a1cbe41-2f10-4f2a-a723-254ce17995ea [ 1123.689036] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.689184] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.689254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.689475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.689565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.689665] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a1cbe41-2f10-4f2a-a723-254ce17995ea already deleted. [ 1123.689745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a1cbe41-2f10-4f2a-a723-254ce17995ea" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.646341] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1124.648613] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 1124.648613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.186337] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1128.186724] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1128.675318] env[62909]: INFO networking_nsxv3.common.synchronization [req-5426d149-aeb5-47a4-af00-46406e83ea3b req-5cf80fc4-d622-4587-9df9-912c98d461c6 tempest-AttachVolumeTestJSON-255914310 tempest-AttachVolumeTestJSON-255914310-project-member] Enqueued Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_members [ 1128.675397] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_members [ 1128.675696] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.675811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.675874] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.676519] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.676708] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.676801] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.676877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.677048] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.677141] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.677847] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.051295] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-966 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.051295] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-966" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.051295] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-966" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.051295] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-966" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.051295] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.051295] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.051295] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.051730] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.051730] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.051876] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.052025] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.052149] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.052282] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.052400] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.052511] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.052650] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.077031] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.077031] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1129.077031] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.077031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-966" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.077031] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-5e05c7fc-1efe-4e76-b521-ac8bcee07403 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.077031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-5e05c7fc-1efe-4e76-b521-ac8bcee07403" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.077031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-5e05c7fc-1efe-4e76-b521-ac8bcee07403" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.077031] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-5e05c7fc-1efe-4e76-b521-ac8bcee07403" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.077031] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e05c7fc-1efe-4e76-b521-ac8bcee07403',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.181512] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.181512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.181512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.181512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.181512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.181512] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.181512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.181512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.181512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.181512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.181512] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 already deleted. [ 1129.181512] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.335941] env[62909]: INFO networking_nsxv3.common.synchronization [req-69130e06-ba06-4492-97fc-f06c1419a294 req-d4d9e4b6-095c-4a70-80c6-4374c38da05e tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_members [ 1129.336577] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd with Priority: HIGHEST for action security_group_members [ 1129.336893] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.337020] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.339414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.339643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.339909] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.339909] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.340153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.340153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.340231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.340403] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaab03b-ddb9-4244-b03d-9b5a1b7172bd',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.579888] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.580154] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.580291] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.580655] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.580831] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.581118] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 5e05c7fc-1efe-4e76-b521-ac8bcee07403 not found, creating... [ 1129.581400] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.581570] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.581694] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.581938] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.582092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.582398] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.582578] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.582703] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.582926] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.583171] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.583354] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 5e05c7fc-1efe-4e76-b521-ac8bcee07403 is going to be created. [ 1129.604703] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.604899] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.605037] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.605323] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.605577] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.605810] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-5e05c7fc-1efe-4e76-b521-ac8bcee07403" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.844420] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.844690] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.844759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.845170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.845170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.846199] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.846199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.846199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.846199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.846199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.846199] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd is going to be updated. [ 1129.875200] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.875344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.875426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.875613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.875754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.886896] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd in Status: IN_PROGRESS for 2s [ 1130.317248] env[62909]: INFO networking_nsxv3.common.synchronization [req-5426d149-aeb5-47a4-af00-46406e83ea3b req-6bbcf651-6fc5-423f-a526-30b6b8f4282f service nova] Enqueued Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_rules [ 1130.317433] env[62909]: INFO networking_nsxv3.common.synchronization [req-5426d149-aeb5-47a4-af00-46406e83ea3b req-6bbcf651-6fc5-423f-a526-30b6b8f4282f service nova] Enqueued Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_members [ 1130.317573] env[62909]: INFO networking_nsxv3.common.synchronization [req-5426d149-aeb5-47a4-af00-46406e83ea3b req-6bbcf651-6fc5-423f-a526-30b6b8f4282f service nova] Enqueued Resource ID: 5e05c7fc-1efe-4e76-b521-ac8bcee07403 with Priority: HIGHEST for action port [ 1130.317801] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_rules [ 1130.317926] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_members [ 1130.318030] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e05c7fc-1efe-4e76-b521-ac8bcee07403 with Priority: HIGHEST for action port [ 1130.318563] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.318688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.318756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.318954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.320627] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.321563] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.321686] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.321973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.322199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.322366] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.322462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.322524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.322672] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.322752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.322839] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.323666] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e05c7fc-1efe-4e76-b521-ac8bcee07403 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.323776] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e05c7fc-1efe-4e76-b521-ac8bcee07403" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.323833] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e05c7fc-1efe-4e76-b521-ac8bcee07403" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.323975] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e05c7fc-1efe-4e76-b521-ac8bcee07403" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.324300] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e05c7fc-1efe-4e76-b521-ac8bcee07403',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.825809] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.826166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.826166] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.827363] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e05c7fc-1efe-4e76-b521-ac8bcee07403 with status ACTIVE [ 1130.827966] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.827966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.827966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.827966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.828208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.828208] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.828869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.828869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.828869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.828869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.828869] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.828869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.829383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.829383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.829383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.829383] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e05c7fc-1efe-4e76-b521-ac8bcee07403 is going to be updated. [ 1130.857033] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.857257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.857257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.857447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.857636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.857754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e05c7fc-1efe-4e76-b521-ac8bcee07403" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.039893] env[62909]: INFO networking_nsxv3.common.synchronization [req-7d09592d-7b31-4713-9ed1-3fc97cace7ab req-2c0a9e63-6099-42b5-b2b2-e3a289882d54 tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1131.040677] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1131.041025] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.041216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.041683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.041683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.041683] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.041948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.041948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.041948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.042064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.042128] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.333612] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.380205] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.380205] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.380205] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.380205] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.380205] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.380205] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.380205] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.380205] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.380205] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.380943] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.380943] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.380943] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.380943] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.380943] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.381177] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.381177] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.399470] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.401634] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1131.401634] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.401634] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-94" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.401634] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-7028ef5c-ed0b-41c9-9ddb-2662c3a38b54 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.401634] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-7028ef5c-ed0b-41c9-9ddb-2662c3a38b54" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.401634] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-7028ef5c-ed0b-41c9-9ddb-2662c3a38b54" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.401634] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-7028ef5c-ed0b-41c9-9ddb-2662c3a38b54" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.401634] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7028ef5c-ed0b-41c9-9ddb-2662c3a38b54',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.547458] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.836058] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.836058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.836058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.836058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.836598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.836598] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 is going to be created. [ 1131.862632] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.862838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.862838] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.863025] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.863213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.875916] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 in Status: UNINITIALIZED for 2s [ 1131.895567] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd in Status: SUCCESS [ 1131.895746] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaab03b-ddb9-4244-b03d-9b5a1b7172bd deletion is rescheduled due to dependency. [ 1131.895857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaab03b-ddb9-4244-b03d-9b5a1b7172bd" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.903566] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.903753] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.903878] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.904183] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.904346] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.904499] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 7028ef5c-ed0b-41c9-9ddb-2662c3a38b54 not found, creating... [ 1131.904756] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.904918] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.905052] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.905285] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.905420] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.905741] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.905903] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.906043] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.906256] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.906395] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.906538] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 7028ef5c-ed0b-41c9-9ddb-2662c3a38b54 is going to be created. [ 1131.924889] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.925118] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.925249] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.925639] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.925891] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.926140] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-7028ef5c-ed0b-41c9-9ddb-2662c3a38b54" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.049606] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.553734] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.553734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.553734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.553734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.553734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.553734] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1132.586022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.588424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.588744] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.589361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.589816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.599833] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1132.985440] env[62909]: INFO networking_nsxv3.common.synchronization [req-7d09592d-7b31-4713-9ed1-3fc97cace7ab req-986faaee-ec5b-4598-85dd-c1b42826ab13 service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 1132.985440] env[62909]: INFO networking_nsxv3.common.synchronization [req-7d09592d-7b31-4713-9ed1-3fc97cace7ab req-986faaee-ec5b-4598-85dd-c1b42826ab13 service nova] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1132.985440] env[62909]: INFO networking_nsxv3.common.synchronization [req-7d09592d-7b31-4713-9ed1-3fc97cace7ab req-986faaee-ec5b-4598-85dd-c1b42826ab13 service nova] Enqueued Resource ID: 7028ef5c-ed0b-41c9-9ddb-2662c3a38b54 with Priority: HIGHEST for action port [ 1132.985440] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_rules [ 1132.985440] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1132.985440] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7028ef5c-ed0b-41c9-9ddb-2662c3a38b54 with Priority: HIGHEST for action port [ 1132.985440] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.985440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.985440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.985440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.985440] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.987680] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.987680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.987841] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-7028ef5c-ed0b-41c9-9ddb-2662c3a38b54 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.987901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7028ef5c-ed0b-41c9-9ddb-2662c3a38b54" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.987932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7028ef5c-ed0b-41c9-9ddb-2662c3a38b54" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.988128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7028ef5c-ed0b-41c9-9ddb-2662c3a38b54" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.988508] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7028ef5c-ed0b-41c9-9ddb-2662c3a38b54',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.423884] env[62909]: INFO networking_nsxv3.common.synchronization [req-69c111c5-e326-45fc-b4e2-1651991ef730 req-b910c64d-f209-442d-b5c9-ba4cd487cce5 tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1133.423884] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1133.423884] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.426677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.426871] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.427061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.427895] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.427895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.427895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.427895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.427895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.427895] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.488136] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.488136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.492857] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7028ef5c-ed0b-41c9-9ddb-2662c3a38b54 with status ACTIVE [ 1133.492857] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.492857] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.492857] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.492857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.492857] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7028ef5c-ed0b-41c9-9ddb-2662c3a38b54 is going to be updated. [ 1133.513511] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.513701] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.513742] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.513936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.514081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.514272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7028ef5c-ed0b-41c9-9ddb-2662c3a38b54" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.707802] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.708032] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.708157] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.708454] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.708687] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.708855] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.708979] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.709712] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.709712] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.709833] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.709913] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.710052] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.710173] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.710297] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.710408] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.710544] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.729314] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.729314] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1133.729314] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.729497] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-60" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.730288] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-2c6def1a-051c-4671-bee1-4eeefcd24ae3 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.730288] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-2c6def1a-051c-4671-bee1-4eeefcd24ae3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.730288] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-2c6def1a-051c-4671-bee1-4eeefcd24ae3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.730551] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-2c6def1a-051c-4671-bee1-4eeefcd24ae3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.730699] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c6def1a-051c-4671-bee1-4eeefcd24ae3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.885922] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 in Status: SUCCESS [ 1133.886167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.886346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.886606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.886796] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.886947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.886980] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.887271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.887271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.887360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.887395] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.929776] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.929957] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.930028] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.930213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.930308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.930555] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.930659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.930717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.930868] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.930946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.931051] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1133.961729] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.961875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.961915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.962142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.962280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.973406] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1134.233824] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.234266] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.234327] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.235075] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.235075] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.235075] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 2c6def1a-051c-4671-bee1-4eeefcd24ae3 not found, creating... [ 1134.235327] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.235526] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.235640] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.235820] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.235960] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.236311] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.236487] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.236636] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.236918] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.237080] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.237229] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 2c6def1a-051c-4671-bee1-4eeefcd24ae3 is going to be created. [ 1134.256447] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.256693] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.256869] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.257206] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.257502] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.257771] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-2c6def1a-051c-4671-bee1-4eeefcd24ae3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.390853] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.609240] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1134.609240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.609240] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.609409] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.609552] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.609859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.609859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.609957] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.609957] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.610061] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.892615] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2764c19d-142c-47d2-aaf7-5c0e20ed83f2: rpc.has_security_group_logging(os_id): False [ 1134.911250] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.911424] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.911494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.911711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.911804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.912060] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.912173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.912234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.912383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.912459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.912545] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 is going to be created. [ 1134.975851] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.976067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.976150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.976359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.977031] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.989677] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 in Status: IN_PROGRESS for 2s [ 1135.113518] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.450180] env[62909]: INFO networking_nsxv3.common.synchronization [req-69c111c5-e326-45fc-b4e2-1651991ef730 req-c10f050f-63ad-4a50-b36d-00995d93af54 service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 1135.450683] env[62909]: INFO networking_nsxv3.common.synchronization [req-69c111c5-e326-45fc-b4e2-1651991ef730 req-c10f050f-63ad-4a50-b36d-00995d93af54 service nova] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1135.450683] env[62909]: INFO networking_nsxv3.common.synchronization [req-69c111c5-e326-45fc-b4e2-1651991ef730 req-c10f050f-63ad-4a50-b36d-00995d93af54 service nova] Enqueued Resource ID: 2c6def1a-051c-4671-bee1-4eeefcd24ae3 with Priority: HIGHEST for action port [ 1135.450787] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_rules [ 1135.450848] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1135.450926] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6def1a-051c-4671-bee1-4eeefcd24ae3 with Priority: HIGHEST for action port [ 1135.451501] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.451628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.451709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.451920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.451993] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.452948] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.453098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.453413] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c6def1a-051c-4671-bee1-4eeefcd24ae3 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.453565] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c6def1a-051c-4671-bee1-4eeefcd24ae3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.453664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c6def1a-051c-4671-bee1-4eeefcd24ae3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.453875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c6def1a-051c-4671-bee1-4eeefcd24ae3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.453997] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c6def1a-051c-4671-bee1-4eeefcd24ae3',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.615281] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.956368] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.956636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.956911] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c6def1a-051c-4671-bee1-4eeefcd24ae3 with status ACTIVE [ 1135.957199] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.957387] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.957492] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.957701] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.957781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.958017] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.958140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.958208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.958397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.958525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.958730] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.958826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.958886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.959084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.959171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.959312] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c6def1a-051c-4671-bee1-4eeefcd24ae3 is going to be updated. [ 1135.986949] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1135.987151] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 1135.987275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.987440] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.987658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.987834] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.987969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.988038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.988190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.988272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.988367] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.009586] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.009787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.009884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.010162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.010305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.010477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c6def1a-051c-4671-bee1-4eeefcd24ae3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.118616] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.118849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.118954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.119286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.119429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.119575] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1136.161782] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.161978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.162026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.162281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.162460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.172561] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1136.490267] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.993294] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.005368] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 in Status: SUCCESS [ 1137.005691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.497986] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.498641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.498641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.498641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.498641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.499065] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1137.529884] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.530075] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.530139] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.530321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.530474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.542120] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1138.184852] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1138.185114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.186837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.186837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.186837] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.186837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.186837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.186837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.186837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.186837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.186837] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.695261] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.695655] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.695655] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.695757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.695885] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.695984] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.696056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.696461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.696601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.696724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.696923] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.697026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.697088] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.697238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.697374] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.697475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.697534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.697679] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.697751] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.697826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.697912] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.201771] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57568fd4-ee2b-43e3-a228-9a168490f0f5: rpc.has_security_group_logging(os_id): False [ 1139.224019] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.224166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.224245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.224507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.224604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.224843] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.224944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.225014] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.225185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.225261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.225452] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.225549] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.225612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.225750] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.225820] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.225993] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.226480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.226556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.226706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.226782] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.226867] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1139.289018] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.289160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.289223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.289430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.289573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.311768] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1139.556623] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1139.556623] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.557943] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.558273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.558499] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.558966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.558966] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.559196] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.559271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.559699] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.559699] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.062359] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.062826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.062826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.062826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.062987] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.063216] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.063351] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.063637] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.063777] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.063943] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.064239] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.064472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.064626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.065112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.065415] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.065626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.065834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.066228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.066359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.066700] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.066878] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.451714] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1140.451930] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1140.571644] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00039edf-d86f-462e-a706-bad2d411b887: rpc.has_security_group_logging(os_id): False [ 1140.590890] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.591069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.591421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.591480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.591597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.591835] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.591964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.592013] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.592200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.592296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.592511] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.592605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.592669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.592816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.592883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.593095] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.593193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.593273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.593574] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.593668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.593770] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1140.664630] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.664884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.664884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.665103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.665247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.686410] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1141.328472] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1141.328884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.545301] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.545637] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.545756] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.546331] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.546635] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.546811] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.546943] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.547195] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.547346] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.547563] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1142.547772] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.547893] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.548016] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.548141] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1142.548263] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.548394] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.570696] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.570960] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1142.571220] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.571487] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-444" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.571937] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-8d6d259f-1ebc-4e49-b6f8-114f414606f7 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.572145] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.572285] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.572626] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.572833] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d6d259f-1ebc-4e49-b6f8-114f414606f7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.727392] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1142.727608] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.076161] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.076338] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.076338] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.076687] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.077296] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.077296] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.077481] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.077481] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.077781] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.077852] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.078223] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.078397] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.078523] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.078736] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.078896] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.079062] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 8d6d259f-1ebc-4e49-b6f8-114f414606f7 is going to be updated. [ 1143.102750] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.102750] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.102750] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.103060] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.103146] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.103491] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.873692] env[62909]: INFO networking_nsxv3.common.synchronization [req-3e227a35-2a45-4a65-8689-841491e60405 req-d1447b9a-6377-4470-9c00-1869c6d6604b service nova] Enqueued Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_rules [ 1143.873962] env[62909]: INFO networking_nsxv3.common.synchronization [req-3e227a35-2a45-4a65-8689-841491e60405 req-d1447b9a-6377-4470-9c00-1869c6d6604b service nova] Enqueued Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_members [ 1143.874047] env[62909]: INFO networking_nsxv3.common.synchronization [req-3e227a35-2a45-4a65-8689-841491e60405 req-d1447b9a-6377-4470-9c00-1869c6d6604b service nova] Enqueued Resource ID: 8d6d259f-1ebc-4e49-b6f8-114f414606f7 with Priority: HIGHEST for action port [ 1143.874619] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_rules [ 1143.874770] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_members [ 1143.874868] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6d259f-1ebc-4e49-b6f8-114f414606f7 with Priority: HIGHEST for action port [ 1143.875312] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.875494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.875548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.875723] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.875826] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.876728] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.876876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.876923] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.877129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.877277] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.878094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.878094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.878094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.878094] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.878094] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.878946] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d6d259f-1ebc-4e49-b6f8-114f414606f7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.879071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.879142] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.879331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.879384] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d6d259f-1ebc-4e49-b6f8-114f414606f7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.380944] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.382098] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.382235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.386897] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d6d259f-1ebc-4e49-b6f8-114f414606f7 with status ACTIVE [ 1144.386897] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.386897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.386897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.386897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.386897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.386897] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.386897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.386897] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.387380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.387380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.387380] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.387547] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.387547] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.387712] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.387800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.388019] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d6d259f-1ebc-4e49-b6f8-114f414606f7 is going to be updated. [ 1144.411857] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.412041] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.412109] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.412318] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.412475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.412668] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d6d259f-1ebc-4e49-b6f8-114f414606f7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.883240] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.267803] env[62909]: INFO networking_nsxv3.common.synchronization [req-1d512f0e-b7f3-4c90-b95b-47eb8dfe58e7 req-184923cd-2713-46b4-b1b3-891d2c9a98eb tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_members [ 1145.269490] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGHEST for action security_group_members [ 1145.270104] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-e666168c-26eb-4fba-8f02-30bb3eb590d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.270104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.270214] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.270479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.270747] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.270895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.270987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.271193] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.271347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.271523] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.386137] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.386388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.386487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.386778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.386937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.387260] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 is going to be updated. [ 1145.426737] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.426969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.427124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.427466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.427697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.439686] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 in Status: IN_PROGRESS for 2s [ 1145.720345] env[62909]: INFO networking_nsxv3.common.synchronization [req-901aa74d-a63b-4f7f-bc39-8d61f54f9565 req-a1182ab9-eedd-416f-ad21-a950eaf42b8b tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1145.720345] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1145.720345] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.720345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.720345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.720759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.720759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.724158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.724375] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.724879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.724879] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.724879] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.777210] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.777806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.777806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.777806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.777806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.777991] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.778122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.778173] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.778317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.778588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.778588] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 is going to be updated. [ 1145.811790] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.811961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.812043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.812276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.812477] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.825790] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 in Status: IN_PROGRESS for 2s [ 1146.227275] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.733457] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.236494] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.236951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.236951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.238544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.238544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.238544] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1147.273676] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.273883] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.273958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.274167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.274318] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.286938] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1147.449847] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 in Status: SUCCESS [ 1147.450108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.450299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.450542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.450743] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.450862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.450927] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.451097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.451190] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.451290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.451437] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.836254] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 in Status: SUCCESS [ 1147.836476] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 deletion is rescheduled due to dependency. [ 1147.836562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.956270] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.458592] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cd42ad4-be75-455d-aff0-14bd3f6e0236: rpc.has_security_group_logging(os_id): False [ 1148.487994] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.488170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.488209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.488470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.488564] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.488885] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.489049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.489049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.489205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.489276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.489356] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 is going to be updated. [ 1148.553995] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.554197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.554276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.554522] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.554672] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.571419] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 in Status: IN_PROGRESS for 2s [ 1149.299069] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1149.299285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.586900] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 in Status: SUCCESS [ 1150.588209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.721526] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1150.721526] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1151.486582] env[62909]: INFO networking_nsxv3.common.synchronization [req-7b65818c-84c7-49f4-9fee-40a4190b24c8 req-98ac956d-7430-4f07-931a-147b440a0c15 tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_members [ 1151.487451] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc95494-492e-4f83-a225-dc8ad461b515 with Priority: HIGHEST for action security_group_members [ 1151.487710] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc95494-492e-4f83-a225-dc8ad461b515 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.488033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.488148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.488470] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.489331] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.489481] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.489654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.489913] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.490327] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.490441] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc95494-492e-4f83-a225-dc8ad461b515',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.994122] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.994601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.994601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.995260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.995260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.995260] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.995659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.995659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.995659] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.995858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.996360] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc95494-492e-4f83-a225-dc8ad461b515 is going to be updated. [ 1152.033185] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.033185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1152.033469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.033579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1152.033960] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1152.045187] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc95494-492e-4f83-a225-dc8ad461b515 in Status: IN_PROGRESS for 2s [ 1152.579382] env[62909]: INFO networking_nsxv3.common.synchronization [None req-fa1ea0ad-c232-4439-b86d-59e8c184f324 tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_rules [ 1152.579850] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_rules [ 1152.580177] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.580315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1152.580383] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.580823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1152.580924] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.666469] env[62909]: INFO networking_nsxv3.common.synchronization [None req-feeb653c-11b7-4d78-b24a-19f5d84cb95b tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_rules [ 1152.667084] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_rules [ 1152.667441] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.667558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.105392] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.106513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.106513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.106513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.106513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.106513] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 already deleted. [ 1153.106513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.106513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.106513] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.106821] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.637778] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.637778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.637778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.637778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.638178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.638178] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 already deleted. [ 1153.638178] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.674262] env[62909]: INFO networking_nsxv3.common.synchronization [req-2a85bb2b-9b7a-4418-b53d-c25f0cd1287f req-f4ba3ee9-9921-4d6c-bd42-063d90303094 tempest-ServerActionsV293TestJSON-301243714 tempest-ServerActionsV293TestJSON-301243714-project-member] Enqueued Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_members [ 1153.674430] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGHEST for action security_group_members [ 1153.675546] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.675546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.675546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.675817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.677311] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.677311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.677311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.677311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.677311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.677311] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.713969] env[62909]: INFO networking_nsxv3.common.synchronization [req-0955b9c2-42c0-4100-ac03-1440136bf13f req-19112e9f-5667-4a5c-ada3-2b5d85788631 tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_members [ 1153.714593] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 with Priority: HIGHEST for action security_group_members [ 1153.715021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.718786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.718786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.718978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.719187] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.719312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.719376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.719658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.719658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.719781] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a69ff3e-5b01-4156-a417-d9c5f614e7e4',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.059367] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc95494-492e-4f83-a225-dc8ad461b515 in Status: SUCCESS [ 1154.059367] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc95494-492e-4f83-a225-dc8ad461b515 deletion is rescheduled due to dependency. [ 1154.059367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc95494-492e-4f83-a225-dc8ad461b515" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.181087] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.181539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.181539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.182342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.182594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.182871] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.183236] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.183372] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.183965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.184120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.184227] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 is going to be updated. [ 1154.219581] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.221959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.221959] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.222103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.222350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.226358] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.226932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.227043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.228010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.228170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.228431] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.228651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.229174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.229174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.229174] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.230328] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 is going to be updated. [ 1154.242715] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 in Status: IN_PROGRESS for 2s [ 1154.266298] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.266298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.266478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.266568] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.266712] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.276102] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 in Status: IN_PROGRESS for 2s [ 1156.252017] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 in Status: SUCCESS [ 1156.252502] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 deletion is rescheduled due to dependency. [ 1156.252502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1156.287290] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 in Status: SUCCESS [ 1156.287354] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a69ff3e-5b01-4156-a417-d9c5f614e7e4 deletion is rescheduled due to dependency. [ 1156.287814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a69ff3e-5b01-4156-a417-d9c5f614e7e4" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1156.966475] env[62909]: INFO networking_nsxv3.common.synchronization [req-13eea630-255a-41d6-8d80-c56eb91e7230 req-6b17b688-361e-401a-82ba-b376578cfcce tempest-ServersTestJSON-1645965215 tempest-ServersTestJSON-1645965215-project-member] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1156.966475] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGHEST for action security_group_members [ 1156.966475] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.966475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1156.966475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.966475] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1156.966475] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.966771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1156.966771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.966771] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1156.966859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1156.966919] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.469068] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.469400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.469400] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.469555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.469637] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.469880] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.469973] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.470038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.470169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.470345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.470345] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be updated. [ 1157.501970] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.502170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.502225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.502410] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.502555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.511582] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: IN_PROGRESS for 2s [ 1159.523539] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 in Status: SUCCESS [ 1159.523539] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 deletion is rescheduled due to dependency. [ 1159.523539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1161.966864] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1161.967301] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1166.967855] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1166.967855] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1167.473227] env[62909]: INFO networking_nsxv3.common.synchronization [req-f486ddab-70d0-4c26-a245-761a8a940d4b req-c4a699bc-92b4-4da8-bd84-a10f9f3d2219 tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_members [ 1167.473749] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_members [ 1167.474181] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.474356] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.474468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.474841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.474967] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.475231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.475297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.475461] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.475543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.475645] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.729980] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.730210] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.730339] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.730616] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.730874] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.731042] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.731164] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.731381] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.731532] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.731787] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.731873] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1167.731984] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1167.732138] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1167.732256] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.732365] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1167.732499] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1167.754269] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1167.754443] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1167.754530] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1167.754738] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.755140] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-38dca680-426a-4e56-834d-e95b4f9d439f taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.755436] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-38dca680-426a-4e56-834d-e95b4f9d439f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.755673] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-38dca680-426a-4e56-834d-e95b4f9d439f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.756137] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-38dca680-426a-4e56-834d-e95b4f9d439f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.756363] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38dca680-426a-4e56-834d-e95b4f9d439f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.977444] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.977816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.977816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.977816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.977816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.978080] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.978186] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.978246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.978401] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.978469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.978553] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 already deleted. [ 1167.978628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.259338] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.259572] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1168.259703] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.259987] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1168.260157] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.260318] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 38dca680-426a-4e56-834d-e95b4f9d439f not found, creating... [ 1168.260641] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.260795] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1168.260922] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.261167] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1168.261309] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.261888] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.262199] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1168.262379] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.262675] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1168.262843] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.262993] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 38dca680-426a-4e56-834d-e95b4f9d439f is going to be created. [ 1168.282808] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.283036] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1168.283036] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.283266] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1168.283505] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.283799] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-38dca680-426a-4e56-834d-e95b4f9d439f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.231407] env[62909]: INFO networking_nsxv3.common.synchronization [req-f486ddab-70d0-4c26-a245-761a8a940d4b req-02aabdbd-1a4c-45ef-a099-2749096af532 service nova] Enqueued Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_rules [ 1169.231407] env[62909]: INFO networking_nsxv3.common.synchronization [req-f486ddab-70d0-4c26-a245-761a8a940d4b req-02aabdbd-1a4c-45ef-a099-2749096af532 service nova] Enqueued Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_members [ 1169.231407] env[62909]: INFO networking_nsxv3.common.synchronization [req-f486ddab-70d0-4c26-a245-761a8a940d4b req-02aabdbd-1a4c-45ef-a099-2749096af532 service nova] Enqueued Resource ID: 38dca680-426a-4e56-834d-e95b4f9d439f with Priority: HIGHEST for action port [ 1169.231407] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_rules [ 1169.231407] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_members [ 1169.231407] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38dca680-426a-4e56-834d-e95b4f9d439f with Priority: HIGHEST for action port [ 1169.231407] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.231407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.231407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.233338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.233430] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.234988] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.234988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.234988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.234988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.234988] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.234988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.234988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.235397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.235397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.235397] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.236180] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-38dca680-426a-4e56-834d-e95b4f9d439f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.236328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38dca680-426a-4e56-834d-e95b4f9d439f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.236791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38dca680-426a-4e56-834d-e95b4f9d439f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.236791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38dca680-426a-4e56-834d-e95b4f9d439f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.236791] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38dca680-426a-4e56-834d-e95b4f9d439f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.738729] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.739362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.739362] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.740072] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38dca680-426a-4e56-834d-e95b4f9d439f with status ACTIVE [ 1169.741042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.741042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.741042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.741042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.741042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.741042] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.741042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.741042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.741433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.741433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.741497] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.741542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.741841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.741841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.741949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.741949] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38dca680-426a-4e56-834d-e95b4f9d439f is going to be updated. [ 1169.769366] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.769581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.769581] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.769797] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.769952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.770169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38dca680-426a-4e56-834d-e95b4f9d439f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.249575] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.750772] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.750772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.750772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.750772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.750772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.751144] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 is going to be created. [ 1170.777656] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.777898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.778117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.778908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.778908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.791051] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 in Status: UNINITIALIZED for 2s [ 1172.804273] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 in Status: SUCCESS [ 1172.804675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.804758] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.805067] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.805332] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.805493] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.805585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.805805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.805918] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.806051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.806181] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.308957] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.812445] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1: rpc.has_security_group_logging(os_id): False [ 1173.830596] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.830814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1173.830814] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.831012] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1173.831102] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1173.831344] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.831448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1173.831501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.831651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1173.831784] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1173.831882] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 is going to be created. [ 1173.891396] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.891651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1173.891651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.891806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1173.891995] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1173.909021] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 in Status: IN_PROGRESS for 2s [ 1174.230433] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1174.230571] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1174.353579] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.353790] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.353929] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.354218] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.354475] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.354674] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.354781] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.355249] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.355438] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.355668] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1174.355792] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1174.355909] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1174.356030] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1174.356148] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1174.356258] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1174.356435] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1174.377363] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1174.377539] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1174.377654] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1174.377829] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-601" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.378164] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-949a1716-cbb0-44a7-a0f6-4d27a45071e0 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.378341] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.378465] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.378740] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.378880] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('949a1716-cbb0-44a7-a0f6-4d27a45071e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.881494] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.881949] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.881949] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.882184] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.882347] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.882725] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.882813] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.882933] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.883194] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.883338] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.883633] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.883837] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.883956] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.884189] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.884325] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.884474] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 949a1716-cbb0-44a7-a0f6-4d27a45071e0 is going to be updated. [ 1174.909665] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.909921] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.910008] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.910316] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.910518] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.910748] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1175.621909] env[62909]: INFO networking_nsxv3.common.synchronization [req-a3f69ed8-941a-457c-b5b1-165e3707521b req-4e6aaa8b-7227-4e4d-821d-c7daae5764c1 service nova] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 1175.622145] env[62909]: INFO networking_nsxv3.common.synchronization [req-a3f69ed8-941a-457c-b5b1-165e3707521b req-4e6aaa8b-7227-4e4d-821d-c7daae5764c1 service nova] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 1175.622313] env[62909]: INFO networking_nsxv3.common.synchronization [req-a3f69ed8-941a-457c-b5b1-165e3707521b req-4e6aaa8b-7227-4e4d-821d-c7daae5764c1 service nova] Enqueued Resource ID: 949a1716-cbb0-44a7-a0f6-4d27a45071e0 with Priority: HIGHEST for action port [ 1175.622512] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_rules [ 1175.622649] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 1175.622734] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 949a1716-cbb0-44a7-a0f6-4d27a45071e0 with Priority: HIGHEST for action port [ 1175.623428] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.623560] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.623634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.623855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.623990] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.625245] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.625310] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.625386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.625630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.625791] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.625891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.625956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.626114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.626187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1175.626280] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.627848] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-949a1716-cbb0-44a7-a0f6-4d27a45071e0 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.628045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.628122] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.628287] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.628363] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('949a1716-cbb0-44a7-a0f6-4d27a45071e0',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.921230] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 in Status: SUCCESS [ 1175.921688] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.126580] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.126792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.128077] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.129894] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 949a1716-cbb0-44a7-a0f6-4d27a45071e0 with status ACTIVE [ 1176.129894] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.129894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.129894] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.130175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.130175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.130303] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.130380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.130435] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.130593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.130669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.130845] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.130936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.130996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.131144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.131215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.131298] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 949a1716-cbb0-44a7-a0f6-4d27a45071e0 is going to be updated. [ 1176.156161] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.156391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.156391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.156593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.156798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.156991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-949a1716-cbb0-44a7-a0f6-4d27a45071e0" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.630115] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.132509] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.133095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.133095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.133095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.133095] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.133399] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 1177.158059] env[62909]: INFO networking_nsxv3.common.synchronization [req-7fccadc6-71bd-40aa-af98-1032166ba047 req-5a245a88-9507-4972-ba1e-685c38c676b5 tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 1177.158489] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 1177.158489] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.158613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.158613] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.158819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.158961] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.159180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.159297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.159468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.159685] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.159857] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.164723] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.164942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.165013] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.165247] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.165429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.176509] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 1177.463897] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.464133] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.464265] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.464530] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.464807] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.465528] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.465714] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.465963] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.466155] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.466370] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.466487] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.466602] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.466712] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.466826] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.466936] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.467094] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.485537] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.485747] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.485932] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.486088] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.486426] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-bca6528d-bcd2-409f-b91d-8d3ceb00d244 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.486662] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.486772] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.487073] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.487238] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca6528d-bcd2-409f-b91d-8d3ceb00d244',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.661860] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.662046] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.662120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.662338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.662425] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.662633] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.662724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.662785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.662945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.663082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.663180] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 is going to be deleted. [ 1177.693574] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.693955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.693955] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.694131] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.694199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.694313] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.989188] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.989463] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.989613] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.989899] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.990093] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.990265] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port bca6528d-bcd2-409f-b91d-8d3ceb00d244 not found, creating... [ 1177.990539] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.990704] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.990826] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.991077] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.991249] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.991518] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.991685] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.991824] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.992256] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.992466] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.992676] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: bca6528d-bcd2-409f-b91d-8d3ceb00d244 is going to be created. [ 1178.019359] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.019700] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.019890] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.020261] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.020648] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.021266] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.724424] env[62909]: INFO networking_nsxv3.common.synchronization [req-7fccadc6-71bd-40aa-af98-1032166ba047 req-b502beb0-5e1c-4a16-a502-fdcd469a8f24 service nova] Enqueued Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_rules [ 1178.724765] env[62909]: INFO networking_nsxv3.common.synchronization [req-7fccadc6-71bd-40aa-af98-1032166ba047 req-b502beb0-5e1c-4a16-a502-fdcd469a8f24 service nova] Enqueued Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 1178.724765] env[62909]: INFO networking_nsxv3.common.synchronization [req-7fccadc6-71bd-40aa-af98-1032166ba047 req-b502beb0-5e1c-4a16-a502-fdcd469a8f24 service nova] Enqueued Resource ID: bca6528d-bcd2-409f-b91d-8d3ceb00d244 with Priority: HIGHEST for action port [ 1178.725000] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_rules [ 1178.725146] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 1178.725244] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca6528d-bcd2-409f-b91d-8d3ceb00d244 with Priority: HIGHEST for action port [ 1178.725789] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.725958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.726010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.729183] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.729283] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.730200] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.730343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.730407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.730591] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.730799] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.731384] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.731479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.731644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.731737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.731834] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.732730] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-bca6528d-bcd2-409f-b91d-8d3ceb00d244 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.732841] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.732899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.733087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.733173] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca6528d-bcd2-409f-b91d-8d3ceb00d244',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.188630] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 1179.188856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.189144] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.189270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.189455] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.189569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.189631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.189783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.189860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.189947] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.190047] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.235312] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.236309] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.236433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.236836] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bca6528d-bcd2-409f-b91d-8d3ceb00d244 with status ACTIVE [ 1179.237027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.237153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.237219] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.237413] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.237501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.237668] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.237761] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.237817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.237963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.238051] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.238229] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.238317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.238375] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.238508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.238617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.238662] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bca6528d-bcd2-409f-b91d-8d3ceb00d244 is going to be updated. [ 1179.258652] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.258807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.258855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.259071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.259211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.259368] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.692072] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.741074] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.195153] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23297eee-5815-4160-b6ed-90818fa0ab3a: rpc.has_security_group_logging(os_id): False [ 1180.217452] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.217601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.217676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.217903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.217994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.218258] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.218352] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.218416] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.218573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.218640] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.218730] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 1180.244194] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.244194] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.244194] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.244439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.244529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.244632] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 is going to be created. [ 1180.268505] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.268505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.268505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.268505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.268505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.280142] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: UNINITIALIZED for 2s [ 1180.282638] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.282786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.282861] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.283160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.284110] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.299274] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 1182.298846] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: SUCCESS [ 1182.299235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.300380] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.300617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.300824] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.300948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.301030] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.301203] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.301292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.301385] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.301600] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.317109] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 1182.317338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.804809] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.805083] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.805135] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.805344] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.805538] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.805686] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.805787] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.805985] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.806136] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.806279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.806450] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.806546] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.806608] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.806759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.806900] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.806993] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.807069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.807210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.807286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.807366] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.807452] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.309501] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d9e8226-da60-440e-9104-6faa87b1a100: rpc.has_security_group_logging(os_id): False [ 1183.343694] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.343969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.343969] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.344165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.344252] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.344520] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.344644] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.344701] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.344928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.344928] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.345116] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.345212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.345273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.345412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.345484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.345659] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.345766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.345869] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.346084] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.346172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.346273] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 is going to be created. [ 1183.413854] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.414081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.414123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.414322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.414637] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.429644] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: IN_PROGRESS for 2s [ 1183.555738] env[62909]: INFO networking_nsxv3.common.synchronization [req-bfabbd33-5e5d-465b-9062-95b09fda4f2b req-30a9ea66-d373-48af-9f2c-93a4fdd91e39 tempest-DeleteServersTestJSON-844183300 tempest-DeleteServersTestJSON-844183300-project-member] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1183.556336] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGHEST for action security_group_members [ 1183.556644] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.556765] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.556834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.557037] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.557194] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.557292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.557360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.557501] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.557584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.557668] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.060225] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.060432] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1184.060476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.060680] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1184.060774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1184.060984] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.061108] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1184.061175] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.061328] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1184.061408] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1184.061498] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be updated. [ 1184.090661] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.090882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1184.090882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.091480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1184.091480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1184.103225] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: IN_PROGRESS for 2s [ 1185.444214] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: SUCCESS [ 1185.444507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.115355] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00039edf-d86f-462e-a706-bad2d411b887 in Status: SUCCESS [ 1186.115568] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00039edf-d86f-462e-a706-bad2d411b887 deletion is rescheduled due to dependency. [ 1186.115672] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.557199] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1188.557556] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1190.371018] env[62909]: INFO networking_nsxv3.common.synchronization [req-f4d07f41-e73b-47be-b9d9-74f42e39b709 req-59f9b618-2207-4e38-88d5-a2822676a96b tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 1190.371550] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGHEST for action security_group_members [ 1190.371855] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.371999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.372129] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.372373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.372571] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.372692] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.372757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.372921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.373010] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.373108] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.428038] env[62909]: INFO networking_nsxv3.common.synchronization [req-f4d07f41-e73b-47be-b9d9-74f42e39b709 req-59f9b618-2207-4e38-88d5-a2822676a96b tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: bca6528d-bcd2-409f-b91d-8d3ceb00d244 with Priority: HIGHEST for action port [ 1190.428356] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca6528d-bcd2-409f-b91d-8d3ceb00d244 with Priority: HIGHEST for action port [ 1190.432022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-bca6528d-bcd2-409f-b91d-8d3ceb00d244 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.432022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.432022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.432022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.432022] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca6528d-bcd2-409f-b91d-8d3ceb00d244',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.875964] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.876187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.876187] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.876364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.876454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.876657] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.876756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.876818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.876965] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.877056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.877142] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 is going to be updated. [ 1190.919322] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.919509] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.919585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.919858] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.920055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.930991] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bca6528d-bcd2-409f-b91d-8d3ceb00d244 with status ACTIVE [ 1190.931293] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.931431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.931998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.931998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.931998] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.933050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.933050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.933050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.933050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.933050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.933050] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.933050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.933050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.933416] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.933416] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.933416] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bca6528d-bcd2-409f-b91d-8d3ceb00d244 is going to be updated. [ 1190.935516] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: IN_PROGRESS for 2s [ 1190.971214] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.971398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.971466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.971646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.971786] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.971964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bca6528d-bcd2-409f-b91d-8d3ceb00d244" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.948948] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9e8226-da60-440e-9104-6faa87b1a100 in Status: SUCCESS [ 1192.949473] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 deletion is rescheduled due to dependency. [ 1192.949473] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.140892] env[62909]: INFO networking_nsxv3.common.synchronization [req-b1289325-f66f-46da-93e3-d239ece866de req-6eb7bafa-6159-48c2-9aef-787386abd83e tempest-ServerActionsTestOtherB-1631848678 tempest-ServerActionsTestOtherB-1631848678-project-member] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 1195.142306] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGHEST for action security_group_members [ 1195.142306] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.142306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.142306] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.142575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.142575] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.142649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.142683] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.142832] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.142921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.143026] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.649089] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.649089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.649089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.649089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.649089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.649089] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.649089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.649089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.649089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.649089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.649089] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be updated. [ 1195.661223] env[62909]: INFO networking_nsxv3.common.synchronization [req-528c8d7d-45a7-4afe-b93f-e70d03a889af req-0ee9adc5-f02d-44bd-9f16-552ae565f8cb tempest-ServerRescueNegativeTestJSON-298244947 tempest-ServerRescueNegativeTestJSON-298244947-project-member] Enqueued Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_members [ 1195.661223] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 with Priority: HIGHEST for action security_group_members [ 1195.661223] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ccded-cd6f-45c9-87f4-02e27e787128 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.661223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.661223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.661223] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.661595] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.661810] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.661963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.662261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.662434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.662603] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d3ccded-cd6f-45c9-87f4-02e27e787128',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.678317] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.679257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.679257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.679538] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.679654] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.691094] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: IN_PROGRESS for 2s [ 1196.164818] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.165205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.165205] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.165276] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.165362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.165562] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.165660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.165724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.165915] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.166079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.166079] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 is going to be updated. [ 1196.193716] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.193916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.193916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.194228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.194438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.204384] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 in Status: IN_PROGRESS for 2s [ 1196.498299] env[62909]: INFO networking_nsxv3.common.synchronization [req-f53f430e-973a-4904-be7c-8f073bf67429 req-6eb921d9-c813-42da-b03e-c20a2f057d93 tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1196.499893] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1196.499893] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.499893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.499893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.499893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.500350] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.500350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.500350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.500483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.500723] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.500723] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.008026] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.008026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.008026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.008026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.008026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.008026] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.008026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.008026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.008026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.008026] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.008026] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1197.038536] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.038536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.038536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.038536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.038536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.046646] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1197.376823] env[62909]: INFO networking_nsxv3.common.synchronization [None req-60d76a19-fd13-43c7-92eb-01e8dee5af3a None None] Enqueued Resource ID: 5c31c2b5-aba0-4401-914f-71d525b39412 with Priority: HIGHEST for action port [ 1197.377447] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c31c2b5-aba0-4401-914f-71d525b39412 with Priority: HIGHEST for action port [ 1197.378040] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c31c2b5-aba0-4401-914f-71d525b39412 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.378170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c31c2b5-aba0-4401-914f-71d525b39412" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.378237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c31c2b5-aba0-4401-914f-71d525b39412" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.380064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c31c2b5-aba0-4401-914f-71d525b39412" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.380064] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c31c2b5-aba0-4401-914f-71d525b39412',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.702262] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23297eee-5815-4160-b6ed-90818fa0ab3a in Status: SUCCESS [ 1197.702420] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a deletion is rescheduled due to dependency. [ 1197.702540] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.881043] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c31c2b5-aba0-4401-914f-71d525b39412 [ 1197.881351] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.881507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1197.881585] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.881844] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1197.881938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1197.882088] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c31c2b5-aba0-4401-914f-71d525b39412 already deleted. [ 1197.882185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c31c2b5-aba0-4401-914f-71d525b39412" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.215082] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 in Status: SUCCESS [ 1198.215276] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ccded-cd6f-45c9-87f4-02e27e787128 deletion is rescheduled due to dependency. [ 1198.215392] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ccded-cd6f-45c9-87f4-02e27e787128" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.058454] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1199.058454] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 deletion is rescheduled due to dependency. [ 1199.058454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.317499] env[62909]: INFO networking_nsxv3.common.synchronization [req-7296af3b-cd97-4773-86ce-834e6918e787 req-37de0656-70d2-4535-9b36-8e8388398d40 tempest-AttachVolumeShelveTestJSON-1170767985 tempest-AttachVolumeShelveTestJSON-1170767985-project-member] Enqueued Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_members [ 1199.318663] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGHEST for action security_group_members [ 1199.319343] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.319796] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.321484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.321484] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.321735] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.321813] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.321863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.322954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.322954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.322954] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.827500] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.827500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.827500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.827500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.827500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.827500] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.827500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.827500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.828200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.828200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.828200] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 is going to be updated. [ 1199.835404] env[62909]: INFO networking_nsxv3.common.synchronization [None req-6acf471c-934e-4f97-87bb-3e01dbc7526b None None] Enqueued Resource ID: 179c9e88-08a9-4e4d-a1bb-6b7faaa41538 with Priority: HIGHEST for action port [ 1199.836333] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179c9e88-08a9-4e4d-a1bb-6b7faaa41538 with Priority: HIGHEST for action port [ 1199.836793] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-179c9e88-08a9-4e4d-a1bb-6b7faaa41538 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.836961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-179c9e88-08a9-4e4d-a1bb-6b7faaa41538" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.837073] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-179c9e88-08a9-4e4d-a1bb-6b7faaa41538" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.837422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-179c9e88-08a9-4e4d-a1bb-6b7faaa41538" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.837541] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('179c9e88-08a9-4e4d-a1bb-6b7faaa41538',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.862029] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.862029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.862737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.862737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.864941] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.876337] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 in Status: IN_PROGRESS for 2s [ 1200.094120] env[62909]: INFO networking_nsxv3.common.synchronization [None req-9d302ca9-f390-44eb-9404-67e54f8afca1 None None] Enqueued Resource ID: b18db772-c135-42ca-aa05-4cc64e5b96dc with Priority: HIGHEST for action port [ 1200.094933] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b18db772-c135-42ca-aa05-4cc64e5b96dc with Priority: HIGHEST for action port [ 1200.100582] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b18db772-c135-42ca-aa05-4cc64e5b96dc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.104911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b18db772-c135-42ca-aa05-4cc64e5b96dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.104911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b18db772-c135-42ca-aa05-4cc64e5b96dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.104911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b18db772-c135-42ca-aa05-4cc64e5b96dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.104911] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b18db772-c135-42ca-aa05-4cc64e5b96dc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.339925] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 179c9e88-08a9-4e4d-a1bb-6b7faaa41538 [ 1200.340236] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.340419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.340478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.340767] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.340891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.341052] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:179c9e88-08a9-4e4d-a1bb-6b7faaa41538 already deleted. [ 1200.341194] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-179c9e88-08a9-4e4d-a1bb-6b7faaa41538" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.612415] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b18db772-c135-42ca-aa05-4cc64e5b96dc [ 1200.612660] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.612790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.612860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.613109] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.613207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.613306] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b18db772-c135-42ca-aa05-4cc64e5b96dc already deleted. [ 1200.613391] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b18db772-c135-42ca-aa05-4cc64e5b96dc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1201.899341] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 in Status: SUCCESS [ 1201.899341] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 deletion is rescheduled due to dependency. [ 1201.899341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1202.776363] env[62909]: INFO networking_nsxv3.common.synchronization [None req-fcb334f3-ed1a-4676-bbbd-184978310b91 None None] Enqueued Resource ID: 45462d89-cb32-44de-b589-bfefd7577179 with Priority: HIGHEST for action port [ 1202.779653] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45462d89-cb32-44de-b589-bfefd7577179 with Priority: HIGHEST for action port [ 1202.780155] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-45462d89-cb32-44de-b589-bfefd7577179 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.780416] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45462d89-cb32-44de-b589-bfefd7577179" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1202.780589] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45462d89-cb32-44de-b589-bfefd7577179" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.780925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45462d89-cb32-44de-b589-bfefd7577179" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1202.781107] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45462d89-cb32-44de-b589-bfefd7577179',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.285459] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45462d89-cb32-44de-b589-bfefd7577179 [ 1203.286029] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.286029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1203.286029] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.286422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1203.286422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1203.286422] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45462d89-cb32-44de-b589-bfefd7577179 already deleted. [ 1203.286422] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45462d89-cb32-44de-b589-bfefd7577179" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.860150] env[62909]: INFO networking_nsxv3.common.synchronization [req-2704ed9f-f99d-456f-b316-f84f50509844 req-aaeeef0d-98ae-43a6-9556-1e428336901a tempest-ServersNegativeTestMultiTenantJSON-2089542293 tempest-ServersNegativeTestMultiTenantJSON-2089542293-project-member] Enqueued Resource ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c with Priority: HIGHEST for action security_group_members [ 1205.860389] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c with Priority: HIGHEST for action security_group_members [ 1205.860473] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ac7e0f4-bba1-4947-8fc9-28766656522c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.860588] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.860650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.860946] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.863133] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.863354] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.863537] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.863807] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.863911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.864109] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ac7e0f4-bba1-4947-8fc9-28766656522c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.263380] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-534 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.263380] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-534" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.263380] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-534" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.263380] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-534" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.263732] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.263732] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.263880] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.264283] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.264445] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.264674] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1206.264795] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1206.264907] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1206.265026] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1206.265150] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1206.265257] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1206.265409] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1206.287914] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1206.288163] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1206.288255] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1206.288422] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-534" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.288741] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-94196113-7172-43c5-82b1-7375a40b8516 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.288916] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-94196113-7172-43c5-82b1-7375a40b8516" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.289049] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-94196113-7172-43c5-82b1-7375a40b8516" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.289499] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-94196113-7172-43c5-82b1-7375a40b8516" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.289595] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94196113-7172-43c5-82b1-7375a40b8516',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.367190] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.367411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.367411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.367606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.367693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.367892] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.367991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.368090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.368227] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.368282] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.368382] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c already deleted. [ 1206.368459] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.791927] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.791927] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.792159] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.792363] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.792521] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.792681] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 94196113-7172-43c5-82b1-7375a40b8516 not found, creating... [ 1206.792968] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.793147] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.793272] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.793501] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.793642] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.793930] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.794299] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.794456] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.794671] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.794821] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.794966] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 94196113-7172-43c5-82b1-7375a40b8516 is going to be created. [ 1206.820222] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.821817] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.822417] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.823323] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.823834] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.824698] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-94196113-7172-43c5-82b1-7375a40b8516" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.049362] env[62909]: INFO networking_nsxv3.common.synchronization [req-47a7d4c7-2f6e-4009-9b5b-0a10a5a094a7 req-57c43939-f531-426d-a048-73314325fba7 tempest-ServerRescueNegativeTestJSON-298244947 tempest-ServerRescueNegativeTestJSON-298244947-project-member] Enqueued Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1207.049362] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1207.049573] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.049641] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.049695] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.050068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.050225] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.050322] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.050381] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.050530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.050609] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.050701] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.533928] env[62909]: INFO networking_nsxv3.common.synchronization [req-2704ed9f-f99d-456f-b316-f84f50509844 req-ccf436f0-3267-4746-8cf3-8db036868dd9 service nova] Enqueued Resource ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c with Priority: HIGHEST for action security_group_rules [ 1207.534215] env[62909]: INFO networking_nsxv3.common.synchronization [req-2704ed9f-f99d-456f-b316-f84f50509844 req-ccf436f0-3267-4746-8cf3-8db036868dd9 service nova] Enqueued Resource ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c with Priority: HIGHEST for action security_group_members [ 1207.534378] env[62909]: INFO networking_nsxv3.common.synchronization [req-2704ed9f-f99d-456f-b316-f84f50509844 req-ccf436f0-3267-4746-8cf3-8db036868dd9 service nova] Enqueued Resource ID: 94196113-7172-43c5-82b1-7375a40b8516 with Priority: HIGHEST for action port [ 1207.534584] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c with Priority: HIGHEST for action security_group_rules [ 1207.534718] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c with Priority: HIGHEST for action security_group_members [ 1207.534814] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94196113-7172-43c5-82b1-7375a40b8516 with Priority: HIGHEST for action port [ 1207.535405] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ac7e0f4-bba1-4947-8fc9-28766656522c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.535556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.535633] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.535891] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.535976] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ac7e0f4-bba1-4947-8fc9-28766656522c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.537293] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ac7e0f4-bba1-4947-8fc9-28766656522c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.537394] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.537434] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.537594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.537774] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.537863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.538074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.538150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.538195] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1207.538251] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ac7e0f4-bba1-4947-8fc9-28766656522c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.538999] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-94196113-7172-43c5-82b1-7375a40b8516 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.539112] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94196113-7172-43c5-82b1-7375a40b8516" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1207.539577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94196113-7172-43c5-82b1-7375a40b8516" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.539577] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94196113-7172-43c5-82b1-7375a40b8516" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1207.539577] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94196113-7172-43c5-82b1-7375a40b8516',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.553267] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.043774] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ac7e0f4-bba1-4947-8fc9-28766656522c taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.043920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.044110] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ac7e0f4-bba1-4947-8fc9-28766656522c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.045255] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94196113-7172-43c5-82b1-7375a40b8516 with status ACTIVE [ 1208.045456] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.045570] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.045635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.045835] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.045916] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.046111] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.046207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.046271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.046508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.046508] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.047862] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.048185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.048185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.048257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.048299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.051830] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94196113-7172-43c5-82b1-7375a40b8516 is going to be updated. [ 1208.055611] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.068415] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.068579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.068631] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.068815] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.068952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.069128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94196113-7172-43c5-82b1-7375a40b8516" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.530710] env[62909]: INFO networking_nsxv3.common.synchronization [req-2ae6647d-f362-4c43-ae73-ca693e087bfb req-a0fce22f-2fd0-4bc4-84a0-e18b7867ca27 tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1208.531413] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1208.531815] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.531992] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.532539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.532748] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.532908] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.533016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.533081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.533302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.533302] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.533400] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.549995] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ac7e0f4-bba1-4947-8fc9-28766656522c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.561865] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.562049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.562123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.562338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.562429] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.562526] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada642ef-0700-436a-87e6-5df9c7267f20 is going to be updated. [ 1208.593417] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.593625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.593625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.594132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.594132] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.602608] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: IN_PROGRESS for 2s [ 1209.038068] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.038068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.038068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.038068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.038068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.038068] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.038068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.038068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.038068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.038068] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.038068] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1209.044223] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-96 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.044223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.044223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.044223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.044223] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.044223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.044223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.044223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.044223] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.047791] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.047791] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.047791] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.047791] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.047791] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.047791] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.047791] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.052022] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.052022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.052022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.052022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.052022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.052603] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c is going to be created. [ 1209.066752] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.069139] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1209.069139] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.069139] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.069139] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-8022bac9-6ae9-47da-a35b-34baa22c828e taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.069139] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-8022bac9-6ae9-47da-a35b-34baa22c828e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.069139] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-8022bac9-6ae9-47da-a35b-34baa22c828e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.069139] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-8022bac9-6ae9-47da-a35b-34baa22c828e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.069139] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8022bac9-6ae9-47da-a35b-34baa22c828e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.071123] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.071272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.071314] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.071499] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.071635] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.079761] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1209.087460] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.087596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.087657] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.087859] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.088042] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.097874] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c in Status: UNINITIALIZED for 2s [ 1209.574235] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.574632] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.574842] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.575111] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.575275] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.575443] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 8022bac9-6ae9-47da-a35b-34baa22c828e not found, creating... [ 1209.575780] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.575981] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.575981] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.576364] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.576364] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.576655] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.576825] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.576959] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.577215] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.577560] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.577560] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 8022bac9-6ae9-47da-a35b-34baa22c828e is going to be created. [ 1209.601770] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.601770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.601770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.601770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.601770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.601770] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-8022bac9-6ae9-47da-a35b-34baa22c828e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.385589] env[62909]: INFO networking_nsxv3.common.synchronization [req-2ae6647d-f362-4c43-ae73-ca693e087bfb req-6e6f0df8-bf07-4c27-a679-15268164525f service nova] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_rules [ 1210.385589] env[62909]: INFO networking_nsxv3.common.synchronization [req-2ae6647d-f362-4c43-ae73-ca693e087bfb req-6e6f0df8-bf07-4c27-a679-15268164525f service nova] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1210.385589] env[62909]: INFO networking_nsxv3.common.synchronization [req-2ae6647d-f362-4c43-ae73-ca693e087bfb req-6e6f0df8-bf07-4c27-a679-15268164525f service nova] Enqueued Resource ID: 8022bac9-6ae9-47da-a35b-34baa22c828e with Priority: HIGHEST for action port [ 1210.385589] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_rules [ 1210.385589] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1210.385589] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8022bac9-6ae9-47da-a35b-34baa22c828e with Priority: HIGHEST for action port [ 1210.387098] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.387098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.387098] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.387301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.387398] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.388310] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.388480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.388735] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-8022bac9-6ae9-47da-a35b-34baa22c828e taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.388888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8022bac9-6ae9-47da-a35b-34baa22c828e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.388988] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8022bac9-6ae9-47da-a35b-34baa22c828e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.389230] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8022bac9-6ae9-47da-a35b-34baa22c828e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.389355] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8022bac9-6ae9-47da-a35b-34baa22c828e',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.615477] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: SUCCESS [ 1210.615800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.892548] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.892694] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.892928] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8022bac9-6ae9-47da-a35b-34baa22c828e with status ACTIVE [ 1210.893149] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.893272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.893362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.893601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.893783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.893909] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.894027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.894115] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.894355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.894454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.894661] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.894785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.894855] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.895033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.895117] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.895216] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8022bac9-6ae9-47da-a35b-34baa22c828e is going to be updated. [ 1210.915636] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.915852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.915852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.916054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.916189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.916435] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8022bac9-6ae9-47da-a35b-34baa22c828e" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.092385] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1211.092580] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 deletion is rescheduled due to dependency. [ 1211.092655] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.092811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.093033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.093292] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.093421] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.093476] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.093639] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.093717] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.093811] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.110925] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c in Status: SUCCESS [ 1211.111179] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.111345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.111566] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.111759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.111875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.111951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.112126] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.112200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.112283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.112372] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ac7e0f4-bba1-4947-8fc9-28766656522c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.595937] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.614383] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ac7e0f4-bba1-4947-8fc9-28766656522c taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.614627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.614627] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.615021] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.615021] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.615160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.615160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.615279] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.615355] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.615444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.615589] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ac7e0f4-bba1-4947-8fc9-28766656522c taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.615682] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.616045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.616045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.616045] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.616197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.616197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.616345] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.616419] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.616504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.616612] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ac7e0f4-bba1-4947-8fc9-28766656522c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.097530] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.118624] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ac7e0f4-bba1-4947-8fc9-28766656522c: rpc.has_security_group_logging(os_id): False [ 1212.140583] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.141082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.141165] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.141447] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.141576] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.141877] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.143092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.143092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.143092] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.143431] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.143753] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.143863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.143863] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.144062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.144301] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.144537] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.144660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.144727] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.144932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.145131] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.145131] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c is going to be created. [ 1212.208689] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.208945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.209071] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.209361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.209572] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.219678] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c in Status: IN_PROGRESS for 2s [ 1212.600711] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.601082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.601082] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.601312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.601466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.601562] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1212.631040] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.631246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1212.631286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.631502] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1212.631643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1212.642133] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1213.559480] env[62909]: INFO networking_nsxv3.common.synchronization [req-e03a469f-b53a-4b1e-ab7c-7985d55102d7 req-dd422284-6a8f-46fc-a84c-60e4b50671ea tempest-ServerRescueNegativeTestJSON-298244947 tempest-ServerRescueNegativeTestJSON-298244947-project-member] Enqueued Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1213.561034] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada642ef-0700-436a-87e6-5df9c7267f20 with Priority: HIGHEST for action security_group_members [ 1213.561034] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada642ef-0700-436a-87e6-5df9c7267f20 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.561034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.561034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.561034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.561347] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.563535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1213.563535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.563535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1213.563535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.563535] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada642ef-0700-436a-87e6-5df9c7267f20',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.065179] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.065504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1214.065504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.065504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1214.065676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1214.065755] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.065865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1214.065942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.066235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1214.066235] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1214.066311] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada642ef-0700-436a-87e6-5df9c7267f20 is going to be updated. [ 1214.097718] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.097968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1214.097968] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.098130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1214.098272] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1214.106408] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: IN_PROGRESS for 2s [ 1214.231527] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c in Status: SUCCESS [ 1214.231768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1214.652342] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1214.652555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1214.652718] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.652938] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1214.653197] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.653319] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1214.653407] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.653544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1214.653623] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1214.653707] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1214.653796] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.156378] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.658860] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ef8091d-5beb-460c-8d49-21cf9cd46551: rpc.has_security_group_logging(os_id): False [ 1215.679688] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.679836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.679888] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.680169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.680283] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1215.680532] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.680630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.680693] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.680848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.680930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1215.681046] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1215.763726] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.763971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.764063] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.764411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.764579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1215.777408] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1216.122979] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada642ef-0700-436a-87e6-5df9c7267f20 in Status: SUCCESS [ 1216.122979] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada642ef-0700-436a-87e6-5df9c7267f20 deletion is rescheduled due to dependency. [ 1216.123220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada642ef-0700-436a-87e6-5df9c7267f20" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.250637] env[62909]: INFO networking_nsxv3.common.synchronization [req-b1221d92-e196-4ae9-853b-74efa16f5e48 req-cc50a902-9dd3-404e-945f-4e33e8188533 tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 1216.251177] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 1216.251476] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.252246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.252246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.252246] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.252246] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.252469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.252469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.253606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.253606] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.253606] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.564945] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.564945] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.564945] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.564945] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.565230] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.565343] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.565467] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.565674] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.565817] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.566043] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.566162] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.566276] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.566385] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.566497] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.566605] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.566745] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.584504] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.584672] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1216.584809] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.584979] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-908" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.585299] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-d93b160a-3672-4d89-8d58-d29cca7cd2cf taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.585500] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-d93b160a-3672-4d89-8d58-d29cca7cd2cf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.585626] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-d93b160a-3672-4d89-8d58-d29cca7cd2cf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.585988] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-d93b160a-3672-4d89-8d58-d29cca7cd2cf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.586165] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d93b160a-3672-4d89-8d58-d29cca7cd2cf',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.755231] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.089028] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.089028] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.089237] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.089485] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.089646] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.089808] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port d93b160a-3672-4d89-8d58-d29cca7cd2cf not found, creating... [ 1217.090090] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.090328] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.090408] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.090650] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.091192] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.091250] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.091419] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.091542] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.091765] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.091906] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.092067] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: d93b160a-3672-4d89-8d58-d29cca7cd2cf is going to be created. [ 1217.119421] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.119603] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.119636] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.120225] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.120225] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.120407] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-d93b160a-3672-4d89-8d58-d29cca7cd2cf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.258165] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.658658] env[62909]: INFO networking_nsxv3.common.synchronization [req-afc08517-530d-4530-8991-8c20559b247e req-e65e111f-766a-4ccc-8f15-a12f5211dde6 tempest-ServersNegativeTestMultiTenantJSON-2089542293 tempest-ServersNegativeTestMultiTenantJSON-2089542293-project-member] Enqueued Resource ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c with Priority: HIGHEST for action security_group_members [ 1217.659205] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c with Priority: HIGHEST for action security_group_members [ 1217.659573] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ac7e0f4-bba1-4947-8fc9-28766656522c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.659783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.659783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.659952] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.660270] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.661783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.661901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.662636] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.662700] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.662759] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ac7e0f4-bba1-4947-8fc9-28766656522c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.760789] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.760977] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.761060] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.761237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.761330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.761432] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 is going to be updated. [ 1217.790210] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.790854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.790930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.791162] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.791312] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.793039] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1217.793229] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.799900] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: IN_PROGRESS for 2s [ 1218.046491] env[62909]: INFO networking_nsxv3.common.synchronization [req-b1221d92-e196-4ae9-853b-74efa16f5e48 req-ac4d7d15-01da-4802-992d-1fa3b9528783 service nova] Enqueued Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_rules [ 1218.047113] env[62909]: INFO networking_nsxv3.common.synchronization [req-b1221d92-e196-4ae9-853b-74efa16f5e48 req-ac4d7d15-01da-4802-992d-1fa3b9528783 service nova] Enqueued Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 1218.047843] env[62909]: INFO networking_nsxv3.common.synchronization [req-b1221d92-e196-4ae9-853b-74efa16f5e48 req-ac4d7d15-01da-4802-992d-1fa3b9528783 service nova] Enqueued Resource ID: d93b160a-3672-4d89-8d58-d29cca7cd2cf with Priority: HIGHEST for action port [ 1218.048261] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_rules [ 1218.048318] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 1218.048415] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d93b160a-3672-4d89-8d58-d29cca7cd2cf with Priority: HIGHEST for action port [ 1218.048993] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.049138] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.049208] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.051895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.051895] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.051895] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.051895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.051895] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-d93b160a-3672-4d89-8d58-d29cca7cd2cf taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.051895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d93b160a-3672-4d89-8d58-d29cca7cd2cf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.051895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d93b160a-3672-4d89-8d58-d29cca7cd2cf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.051895] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d93b160a-3672-4d89-8d58-d29cca7cd2cf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.051895] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d93b160a-3672-4d89-8d58-d29cca7cd2cf',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.170323] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.170323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.170323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.170323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.170323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.170323] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.170323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.170323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.170323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.170323] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.170323] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c is going to be updated. [ 1218.200584] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.200817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.200817] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.201036] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.201177] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.218380] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c in Status: IN_PROGRESS for 2s [ 1218.554388] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d93b160a-3672-4d89-8d58-d29cca7cd2cf with status ACTIVE [ 1218.554695] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.554803] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.554837] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.555061] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.555150] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.555340] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.555471] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.555536] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.555697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.555774] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.555979] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.556069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.556137] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.556286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.556361] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.556436] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d93b160a-3672-4d89-8d58-d29cca7cd2cf is going to be updated. [ 1218.561761] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.561936] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.581675] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.581857] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.581903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.582104] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.582234] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.582404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d93b160a-3672-4d89-8d58-d29cca7cd2cf" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1219.812251] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: SUCCESS [ 1219.812653] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1219.812722] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.812914] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1219.813114] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.813232] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1219.813298] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.813460] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1219.813543] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1219.813685] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.229732] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c in Status: SUCCESS [ 1220.229732] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ac7e0f4-bba1-4947-8fc9-28766656522c deletion is rescheduled due to dependency. [ 1220.229732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ac7e0f4-bba1-4947-8fc9-28766656522c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1220.316557] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.819295] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.323377] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.323647] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.323724] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.324034] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.324137] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.324250] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 is going to be updated. [ 1221.358114] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.358114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.358114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.358114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.358464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.373695] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: IN_PROGRESS for 2s [ 1223.049026] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1223.049432] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1223.388229] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: SUCCESS [ 1223.388427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1223.388558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.388781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1223.388968] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.389090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1223.389163] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.389303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1223.389378] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1223.389469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1223.389571] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.893018] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.398568] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7: rpc.has_security_group_logging(os_id): False [ 1224.417315] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.417555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.417702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.418152] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.441138] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.441507] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.441507] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.441719] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.441757] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.441852] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.441946] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 is going to be updated. [ 1224.503192] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.503348] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.503467] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.503650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.503831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.518927] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: IN_PROGRESS for 2s [ 1226.533150] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: SUCCESS [ 1226.533533] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.050236] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1228.050566] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1232.457766] env[62909]: INFO networking_nsxv3.common.synchronization [req-28947353-70ab-44d2-a930-dda8c53b5e12 req-da4f520f-ba8e-4ed6-8504-7bb111e272f9 tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_members [ 1232.458298] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGHEST for action security_group_members [ 1232.458933] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.458933] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.458933] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.459119] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.460237] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.460237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.460237] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.460535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.460535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.460636] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.963876] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.964189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.964321] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.964625] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.964726] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.964935] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.965052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.965111] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.965280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.965360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.965451] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 is going to be updated. [ 1233.026554] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.026819] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1233.026905] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.027238] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1233.027398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.039086] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 in Status: IN_PROGRESS for 2s [ 1233.304881] env[62909]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1233.305143] env[62909]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a37dd51b-2799-4e86-8148-44d2ecb836dd None None] NSXv3 Agent Agent loop - iteration:3 started [ 1235.049579] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 in Status: SUCCESS [ 1235.049930] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 deletion is rescheduled due to dependency. [ 1235.049930] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.720552] env[62909]: INFO networking_nsxv3.common.synchronization [None req-2469769d-b3cc-4523-a814-3ade0cf935d7 tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_rules [ 1236.721088] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_rules [ 1236.721397] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.721562] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.721658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.721931] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.722483] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('739e20a9-7c77-4c75-bf12-2cffdc2cea28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.796329] env[62909]: INFO networking_nsxv3.common.synchronization [None req-3999ae5f-584d-4fd2-b9ba-944469929672 tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_rules [ 1236.797195] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_rules [ 1236.797195] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.797397] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.246288] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.246445] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.246494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.246759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.246856] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.246978] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 already deleted. [ 1237.247103] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.247266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.247437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.247522] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('739e20a9-7c77-4c75-bf12-2cffdc2cea28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.768432] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.768756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.768756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.769017] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.769231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.769358] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 already deleted. [ 1237.769450] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1241.797989] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1241.798329] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1242.341646] env[62909]: INFO networking_nsxv3.common.synchronization [req-2045cd91-d083-4979-ba2b-395865527ff7 req-71ca85a7-494a-4a71-9b6f-d9a774dc6d62 tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_members [ 1242.341646] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_members [ 1242.341834] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-739e20a9-7c77-4c75-bf12-2cffdc2cea28 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.341940] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.342120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.342487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.342957] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.342957] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.343091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.343335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.343485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.343703] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('739e20a9-7c77-4c75-bf12-2cffdc2cea28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.661357] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.661562] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.661690] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.661973] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.662261] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.662426] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.662557] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.662778] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.662932] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.663161] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1242.663280] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1242.663391] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1242.663504] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1242.663616] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1242.663724] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1242.663857] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1242.684850] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1242.685050] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1242.685182] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1242.685633] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-3" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.686022] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-1555b103-122e-466e-838b-ce49a0c203ae taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.686218] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-1555b103-122e-466e-838b-ce49a0c203ae" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.686344] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-1555b103-122e-466e-838b-ce49a0c203ae" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.686686] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-1555b103-122e-466e-838b-ce49a0c203ae" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.686830] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1555b103-122e-466e-838b-ce49a0c203ae',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.845618] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.846278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.846278] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.846464] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.846605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.846963] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.847135] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1242.847215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.847395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1242.847535] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1242.847596] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 already deleted. [ 1242.847673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1243.180200] env[62909]: INFO networking_nsxv3.common.synchronization [req-1375dd2e-e78a-4d62-9e0d-8e1a909726cf req-ac8c8e9d-3578-4886-ab4d-c590dcabc4b4 tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 1243.180749] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 1243.181089] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.181569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1243.181634] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.182472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1243.182472] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.182472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1243.182472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.182821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1243.182821] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1243.182821] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.189672] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.189672] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1243.189672] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.190012] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1243.190171] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1243.190414] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 1555b103-122e-466e-838b-ce49a0c203ae not found, creating... [ 1243.190767] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.190976] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1243.191165] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.191430] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1243.192350] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1243.192350] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.192480] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1243.192782] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.193119] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1243.193312] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1243.193502] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 1555b103-122e-466e-838b-ce49a0c203ae is going to be created. [ 1243.223727] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.223989] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1243.224084] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.224386] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1243.224678] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1243.224940] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-1555b103-122e-466e-838b-ce49a0c203ae" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1243.684709] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.186884] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.412602] env[62909]: INFO networking_nsxv3.common.synchronization [req-2045cd91-d083-4979-ba2b-395865527ff7 req-caf63cb8-de9b-455e-a3f1-66c955527b14 service nova] Enqueued Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_rules [ 1244.412797] env[62909]: INFO networking_nsxv3.common.synchronization [req-2045cd91-d083-4979-ba2b-395865527ff7 req-caf63cb8-de9b-455e-a3f1-66c955527b14 service nova] Enqueued Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_members [ 1244.412938] env[62909]: INFO networking_nsxv3.common.synchronization [req-2045cd91-d083-4979-ba2b-395865527ff7 req-caf63cb8-de9b-455e-a3f1-66c955527b14 service nova] Enqueued Resource ID: 1555b103-122e-466e-838b-ce49a0c203ae with Priority: HIGHEST for action port [ 1244.413196] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_rules [ 1244.413323] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_members [ 1244.413423] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1555b103-122e-466e-838b-ce49a0c203ae with Priority: HIGHEST for action port [ 1244.413971] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.414433] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.414558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.414865] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.414982] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('739e20a9-7c77-4c75-bf12-2cffdc2cea28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.415982] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-739e20a9-7c77-4c75-bf12-2cffdc2cea28 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.416182] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.416307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.416542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.418406] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.418406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.418406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.418406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.418406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.418406] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('739e20a9-7c77-4c75-bf12-2cffdc2cea28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.418406] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-1555b103-122e-466e-838b-ce49a0c203ae taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.418406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1555b103-122e-466e-838b-ce49a0c203ae" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.418406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1555b103-122e-466e-838b-ce49a0c203ae" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.418406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1555b103-122e-466e-838b-ce49a0c203ae" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.419542] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1555b103-122e-466e-838b-ce49a0c203ae',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.688999] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.689248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.689248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.689462] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.689550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.689650] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 is going to be updated. [ 1244.717660] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.717903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.717903] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.718081] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.718222] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.726624] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: IN_PROGRESS for 2s [ 1244.921218] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-739e20a9-7c77-4c75-bf12-2cffdc2cea28 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.921349] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.921562] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('739e20a9-7c77-4c75-bf12-2cffdc2cea28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.922463] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1555b103-122e-466e-838b-ce49a0c203ae with status ACTIVE [ 1244.922682] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.922806] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.922876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.923089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.923176] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.923348] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.923444] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.923505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.923660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.923734] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.923924] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.924027] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.924089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.924226] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.924299] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.924384] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1555b103-122e-466e-838b-ce49a0c203ae is going to be updated. [ 1244.948445] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.948607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.948655] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.948901] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.949124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.949325] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1555b103-122e-466e-838b-ce49a0c203ae" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.426934] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('739e20a9-7c77-4c75-bf12-2cffdc2cea28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.929261] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.929416] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.929487] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.929698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.929818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.929885] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 is going to be created. [ 1245.954138] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.954561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.954561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.954561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.954781] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.966577] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 in Status: UNINITIALIZED for 2s [ 1246.736817] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: SUCCESS [ 1246.737297] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.975870] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 in Status: SUCCESS [ 1247.976266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.976266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.976454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.976639] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.976752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.976816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.976972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.977062] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.977148] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.977239] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('739e20a9-7c77-4c75-bf12-2cffdc2cea28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.480315] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('739e20a9-7c77-4c75-bf12-2cffdc2cea28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.982454] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 739e20a9-7c77-4c75-bf12-2cffdc2cea28: rpc.has_security_group_logging(os_id): False [ 1249.000200] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.000438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.000438] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.000687] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.000785] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.001281] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.001281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.001281] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.001514] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.001569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.001659] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 is going to be created. [ 1249.062219] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.062485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.062485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.062660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.062880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.075444] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 in Status: IN_PROGRESS for 2s [ 1249.414443] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1249.414633] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1251.088669] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 in Status: SUCCESS [ 1251.088669] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1254.415538] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.415984] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1254.705060] env[62909]: INFO networking_nsxv3.common.synchronization [req-8b5d8834-f3c5-4e2c-95f3-9f8ef2603d59 req-611eeedf-d060-4bf6-9e09-cc1e0dda86f7 tempest-ServerActionsTestOtherA-348254139 tempest-ServerActionsTestOtherA-348254139-project-member] Enqueued Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 1254.707166] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 with Priority: HIGHEST for action security_group_members [ 1254.707166] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.707166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1254.707166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.707166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1254.707166] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.707166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1254.707166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.707791] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1254.707899] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1254.707993] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.210226] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.210439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.210439] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.210670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.210756] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.210957] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.211058] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.211123] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.211271] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.211346] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.211434] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 is going to be updated. [ 1255.237403] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.237550] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.237610] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.237805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.237997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.246840] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: IN_PROGRESS for 2s [ 1257.257400] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 in Status: SUCCESS [ 1257.257731] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7 deletion is rescheduled due to dependency. [ 1257.257731] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1259.709520] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1259.709520] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1264.710248] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.710644] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1267.250353] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.250826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1267.250826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.250911] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1267.250976] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.753184] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.256192] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.759533] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1268.759533] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1269.509834] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.510307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.510307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.510307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.522035] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1269.523099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.524264] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1269.563839] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.564085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.564138] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.564336] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.579677] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.580473] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1269.580561] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1269.580654] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1269.614844] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.615090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.615090] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.615267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.616552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.616728] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1269.697400] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.697554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.697611] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.697818] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.698166] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.698638] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1269.711331] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.711434] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1269.780433] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.780599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.780676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.780876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.781239] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.781529] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1269.781621] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'6132b5e3-d0b8-4a56-b81e-68474f0ca6e1', '1d9e8226-da60-440e-9104-6faa87b1a100', 'ae3dd4dc-00bd-42c2-981b-37dceb5d7e41', 'd5ae12c5-b5af-4b41-a61b-4088bef35c7c', '7ef8091d-5beb-460c-8d49-21cf9cd46551', '2764c19d-142c-47d2-aaf7-5c0e20ed83f2', '23297eee-5815-4160-b6ed-90818fa0ab3a', '57568fd4-ee2b-43e3-a228-9a168490f0f5', '6cd42ad4-be75-455d-aff0-14bd3f6e0236', '1f6e0db7-41ba-43f5-b841-2551ea96a39f', '040e2818-d72e-44b6-b9e0-bdcfefe4cbdc', '24030e1e-897b-4a91-9a5a-7c9e92186e4b', 'e7b8e547-f24c-4b71-8565-214f37cb5c01', 'e666168c-26eb-4fba-8f02-30bb3eb590d8', '828a3fee-5001-4141-bcfb-64c185ab0efa', 'b2821bc4-3047-4598-bd51-10cd2a5b1137', 'cdf04703-55f3-479f-bb4c-a69bd221f98f', '14d66eff-4d06-4f86-92c4-66d09f1004ca', '00039edf-d86f-462e-a706-bad2d411b887', 'f599ba98-bf73-4cc1-922f-b14d6ba06469', '9854b6b4-9fde-4807-83f9-b2838c42920a', '0bc95494-492e-4f83-a225-dc8ad461b515', '85d35f16-322f-4fce-8671-2c59aba9257f', '91426ce9-c57f-42ef-bcee-74c76f9876e0', '7d3ccded-cd6f-45c9-87f4-02e27e787128', 'f69ca0e3-141e-4f4e-89ef-8969cbcbbbf7', '5ac7e0f4-bba1-4947-8fc9-28766656522c', 'f3c6858c-f90d-4b04-bbda-341ff7525e29', '8a69ff3e-5b01-4156-a417-d9c5f614e7e4', 'bbaab03b-ddb9-4244-b03d-9b5a1b7172bd', '037af277-a74d-482c-b3ec-c4b5f5f92980', '82fed768-4b8f-4414-99cd-373f9e532647', '4f25cd97-67bf-4e2d-83cc-0c98ae21dfe5', '7e0b230b-d7d3-4c40-9cdd-92be876b4a05', 'f28a45c0-8394-4cec-b3b7-949be46fb2dd', '11f84bbc-cc8c-4244-87ea-1493e7543f81', '739e20a9-7c77-4c75-bf12-2cffdc2cea28', '009d27ce-c5b1-4df0-81b4-05b91e8ed19e', 'd09a74b6-7c94-44f4-afba-b179607452eb', 'ada642ef-0700-436a-87e6-5df9c7267f20', 'ba398af1-904a-41aa-b098-1f2b15a308ac'} {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1269.781730] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1269.806027] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.806181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.806181] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.806389] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.806478] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.806586] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1269.806660] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1269.806730] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1269.891471] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.891617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.891691] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.891892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.893040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.893309] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1269.893404] env[62909]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62909) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1269.893544] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1269.893544] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1269.893621] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1269.893682] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGH for action security_group_rules [ 1269.893759] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGH for action security_group_rules [ 1269.893824] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGH for action security_group_rules [ 1269.893888] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c with Priority: HIGH for action security_group_rules [ 1269.893948] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGH for action security_group_rules [ 1269.894016] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGH for action security_group_rules [ 1269.894080] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGH for action security_group_rules [ 1269.894141] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGH for action security_group_rules [ 1269.894218] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGH for action security_group_rules [ 1269.894298] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGH for action security_group_rules [ 1269.894361] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGH for action security_group_rules [ 1269.894421] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGH for action security_group_rules [ 1269.894481] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGH for action security_group_rules [ 1269.894541] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGH for action security_group_rules [ 1269.894603] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGH for action security_group_rules [ 1269.894665] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGH for action security_group_rules [ 1269.894725] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cdf04703-55f3-479f-bb4c-a69bd221f98f with Priority: HIGH for action security_group_rules [ 1269.894786] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca with Priority: HIGH for action security_group_rules [ 1269.894847] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGH for action security_group_rules [ 1269.894935] env[62909]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 with Priority: HIGH for action security_group_rules [ 1269.895035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1274.712392] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.712772] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1274.712772] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 with Priority: HIGH for action security_group_rules [ 1274.712772] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 with Priority: HIGH for action security_group_rules [ 1274.712927] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23297eee-5815-4160-b6ed-90818fa0ab3a with Priority: HIGH for action security_group_rules [ 1274.712927] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828a3fee-5001-4141-bcfb-64c185ab0efa with Priority: HIGH for action security_group_rules [ 1274.713023] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 with Priority: HIGH for action security_group_rules [ 1274.713122] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00039edf-d86f-462e-a706-bad2d411b887 with Priority: HIGH for action security_group_rules [ 1274.713210] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca with Priority: HIGH for action security_group_rules [ 1274.713299] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf04703-55f3-479f-bb4c-a69bd221f98f with Priority: HIGH for action security_group_rules [ 1274.713384] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 with Priority: HIGH for action security_group_rules [ 1274.713477] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 with Priority: HIGH for action security_group_rules [ 1274.713565] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 with Priority: HIGH for action security_group_rules [ 1274.713653] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b with Priority: HIGH for action security_group_rules [ 1274.713739] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc with Priority: HIGH for action security_group_rules [ 1274.713825] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f with Priority: HIGH for action security_group_rules [ 1274.713911] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 with Priority: HIGH for action security_group_rules [ 1274.714064] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGH for action security_group_rules [ 1274.714179] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 with Priority: HIGH for action security_group_rules [ 1274.714282] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGH for action security_group_rules [ 1274.714368] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9e8226-da60-440e-9104-6faa87b1a100 with Priority: HIGH for action security_group_rules [ 1274.714455] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c with Priority: HIGH for action security_group_rules [ 1274.714791] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.714921] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.715038] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.715261] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.715344] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6132b5e3-d0b8-4a56-b81e-68474f0ca6e1',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.716357] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.716479] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.716548] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.716718] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.716792] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae3dd4dc-00bd-42c2-981b-37dceb5d7e41',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.717835] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23297eee-5815-4160-b6ed-90818fa0ab3a taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.717944] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.718022] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.718176] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.718247] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23297eee-5815-4160-b6ed-90818fa0ab3a',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.719804] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-828a3fee-5001-4141-bcfb-64c185ab0efa taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.719937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.720050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.720250] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.720325] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('828a3fee-5001-4141-bcfb-64c185ab0efa',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.721060] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f599ba98-bf73-4cc1-922f-b14d6ba06469 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.721210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.721309] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.721534] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.721628] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f599ba98-bf73-4cc1-922f-b14d6ba06469',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.722524] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00039edf-d86f-462e-a706-bad2d411b887 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.722675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.722783] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.722976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.723075] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00039edf-d86f-462e-a706-bad2d411b887',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.723961] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14d66eff-4d06-4f86-92c4-66d09f1004ca taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.724097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.724097] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.724285] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.724356] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14d66eff-4d06-4f86-92c4-66d09f1004ca',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.725107] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdf04703-55f3-479f-bb4c-a69bd221f98f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.725225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.725290] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.725452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.725521] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdf04703-55f3-479f-bb4c-a69bd221f98f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.726257] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e666168c-26eb-4fba-8f02-30bb3eb590d8 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.726412] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.726489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.726642] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.726713] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e666168c-26eb-4fba-8f02-30bb3eb590d8',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.727383] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2821bc4-3047-4598-bd51-10cd2a5b1137 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.727490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.727556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.727700] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.727767] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2821bc4-3047-4598-bd51-10cd2a5b1137',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.728532] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7b8e547-f24c-4b71-8565-214f37cb5c01 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.728638] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.728702] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.728848] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.728916] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7b8e547-f24c-4b71-8565-214f37cb5c01',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.729668] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.729778] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.729842] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.729989] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.730071] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24030e1e-897b-4a91-9a5a-7c9e92186e4b',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.730720] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.730826] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.730892] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.731118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.731186] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('040e2818-d72e-44b6-b9e0-bdcfefe4cbdc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.732271] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.732376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.732448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.732594] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.732662] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f6e0db7-41ba-43f5-b841-2551ea96a39f',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.733479] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.733593] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.733657] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.733816] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.733886] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cd42ad4-be75-455d-aff0-14bd3f6e0236',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.735164] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.735245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.735313] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.735466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.735537] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.736202] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57568fd4-ee2b-43e3-a228-9a168490f0f5 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.736307] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.736363] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.736500] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.736570] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57568fd4-ee2b-43e3-a228-9a168490f0f5',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.737354] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.737465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.737525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.737674] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.737742] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.738536] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d9e8226-da60-440e-9104-6faa87b1a100 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.738772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.738827] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.738982] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.739109] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d9e8226-da60-440e-9104-6faa87b1a100',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.739779] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5ae12c5-b5af-4b41-a61b-4088bef35c7c taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.739886] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1274.739949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.740172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1274.740172] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5ae12c5-b5af-4b41-a61b-4088bef35c7c',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.243091] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.243091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.243091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.243404] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.243478] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.243586] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.243651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.243822] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.243902] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.243986] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.244111] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.259132] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.259364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.259427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.259706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.259805] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.259860] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.259925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.260074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.260160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.260245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.260331] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.312764] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.313018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.313018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.313204] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.315065] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.315212] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.315985] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.316130] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.316791] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.316887] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.317635] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.317725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.318758] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.318862] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.319575] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.319675] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.332236] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.332457] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.333339] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.333437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.334181] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.334317] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.335294] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.335294] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.336049] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1275.336362] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.336452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.337157] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1275.337627] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.337713] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.338374] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1275.338803] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.338898] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.339519] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1275.339955] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.340063] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.340673] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1275.341090] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.341185] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.341854] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1275.342274] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.342367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.343115] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1275.343552] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.343659] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdf04703-55f3-479f-bb4c-a69bd221f98f is going to be deleted. [ 1275.345266] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.345362] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.345430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.345646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.364710] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.364898] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5ae12c5-b5af-4b41-a61b-4088bef35c7c is going to be deleted. [ 1275.365752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.365971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.383747] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.383907] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23297eee-5815-4160-b6ed-90818fa0ab3a is going to be deleted. [ 1275.384789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.385055] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.408615] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.408882] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.411551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.411697] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f6e0db7-41ba-43f5-b841-2551ea96a39f is going to be deleted. [ 1275.412554] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.412789] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.423897] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.424118] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.451191] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.451426] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00039edf-d86f-462e-a706-bad2d411b887 is going to be deleted. [ 1275.452280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.452503] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.454403] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.454569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.493706] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.493902] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f599ba98-bf73-4cc1-922f-b14d6ba06469 is going to be deleted. [ 1275.494949] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.495231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.524393] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.524612] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.528873] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.529035] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7b8e547-f24c-4b71-8565-214f37cb5c01 is going to be deleted. [ 1275.529925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.530200] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.565436] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.565650] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.577269] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.577469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.586215] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.586388] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 040e2818-d72e-44b6-b9e0-bdcfefe4cbdc is going to be deleted. [ 1275.587330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.587556] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.629449] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.629629] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d9e8226-da60-440e-9104-6faa87b1a100 is going to be deleted. [ 1275.630530] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.630752] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.659115] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.659331] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.673209] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.673388] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 828a3fee-5001-4141-bcfb-64c185ab0efa is going to be deleted. [ 1275.674320] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.674555] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.715382] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.715836] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.730305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.730485] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e666168c-26eb-4fba-8f02-30bb3eb590d8 is going to be deleted. [ 1275.731649] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.731876] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.744330] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.744527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.750947] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.769444] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.795686] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.795872] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2821bc4-3047-4598-bd51-10cd2a5b1137 is going to be deleted. [ 1275.796804] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.797057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.807085] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.807332] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.841059] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.841267] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14d66eff-4d06-4f86-92c4-66d09f1004ca is going to be deleted. [ 1275.842120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.842341] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.876219] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.876445] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.877364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.877491] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae3dd4dc-00bd-42c2-981b-37dceb5d7e41 is going to be deleted. [ 1275.878399] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.878621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.904988] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.905257] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1275.912604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.912806] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24030e1e-897b-4a91-9a5a-7c9e92186e4b is going to be deleted. [ 1275.913733] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.913994] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.955194] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.955386] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6132b5e3-d0b8-4a56-b81e-68474f0ca6e1 is going to be deleted. [ 1275.956266] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.956483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1275.990597] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.990742] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57568fd4-ee2b-43e3-a228-9a168490f0f5 is going to be deleted. [ 1275.991772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.991992] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.037303] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.037511] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.045925] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.046211] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.047697] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.047834] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cd42ad4-be75-455d-aff0-14bd3f6e0236 is going to be deleted. [ 1276.048763] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.048987] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.049089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.049213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdf04703-55f3-479f-bb4c-a69bd221f98f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.049376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.049544] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.049621] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.049732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5ae12c5-b5af-4b41-a61b-4088bef35c7c" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.050270] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.050430] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.050504] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.050651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23297eee-5815-4160-b6ed-90818fa0ab3a" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.050788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.050933] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.051016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.051143] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f6e0db7-41ba-43f5-b841-2551ea96a39f" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.051267] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.051465] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.051584] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.051714] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00039edf-d86f-462e-a706-bad2d411b887" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.051846] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.051991] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.052107] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.052220] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f599ba98-bf73-4cc1-922f-b14d6ba06469" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.052349] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.052491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.052569] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.052681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7b8e547-f24c-4b71-8565-214f37cb5c01" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.052811] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.052961] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.053085] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.053207] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-040e2818-d72e-44b6-b9e0-bdcfefe4cbdc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.053340] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.053490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.053575] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.053670] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d9e8226-da60-440e-9104-6faa87b1a100" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.053794] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.053932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.054016] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.054140] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-828a3fee-5001-4141-bcfb-64c185ab0efa" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.054269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.054411] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.054485] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.054601] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e666168c-26eb-4fba-8f02-30bb3eb590d8" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.054732] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.054875] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.054956] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.055135] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2821bc4-3047-4598-bd51-10cd2a5b1137" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.055269] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.055413] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.055489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.055598] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14d66eff-4d06-4f86-92c4-66d09f1004ca" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.055725] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.055864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.055937] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.056099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae3dd4dc-00bd-42c2-981b-37dceb5d7e41" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.063314] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.063489] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.063529] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.063709] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.063795] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.063907] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24030e1e-897b-4a91-9a5a-7c9e92186e4b" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.064680] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.064793] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.064864] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.065057] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.065160] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.065242] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6132b5e3-d0b8-4a56-b81e-68474f0ca6e1" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.101020] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.101233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.101233] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.101469] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.101558] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.101681] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57568fd4-ee2b-43e3-a228-9a168490f0f5" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.254466] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2764c19d-142c-47d2-aaf7-5c0e20ed83f2: rpc.has_security_group_logging(os_id): False [ 1276.271542] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.271542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.271542] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.271812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.271812] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.271908] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cd42ad4-be75-455d-aff0-14bd3f6e0236" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.272233] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ef8091d-5beb-460c-8d49-21cf9cd46551: rpc.has_security_group_logging(os_id): False [ 1276.296122] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.296342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.296342] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.296480] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.319104] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.319330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.332504] env[62909]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1276.333167] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.333661] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.333764] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.333828] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.334035] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.334119] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.334205] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 is going to be updated. [ 1276.335284] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.335466] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.376772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.377099] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.377224] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.377292] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.377505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.377587] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.377678] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1276.430538] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.430779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.430779] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.430958] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.431120] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.469098] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 in Status: IN_PROGRESS for 2s [ 1276.490045] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.490045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1276.490045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.490045] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1276.490347] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1276.517588] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1278.482730] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 in Status: SUCCESS [ 1278.483225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1278.530260] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1278.530260] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1279.509392] env[62909]: INFO networking_nsxv3.common.synchronization [req-56e05eab-69fa-4ca4-812c-29e7a01d9bc8 req-2fc55d50-dfd3-4dca-9654-6f9dee2f89b4 tempest-AttachVolumeTestJSON-255914310 tempest-AttachVolumeTestJSON-255914310-project-member] Enqueued Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_members [ 1279.510759] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 with Priority: HIGHEST for action security_group_members [ 1279.510759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.510759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1279.510759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.510759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1279.510759] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.510759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1279.510759] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.511155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1279.511155] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1279.511155] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2764c19d-142c-47d2-aaf7-5c0e20ed83f2',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.013516] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.013754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1280.013754] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.013954] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1280.014063] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1280.014265] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.014365] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1280.014426] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.014582] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1280.014658] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1280.014746] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 is going to be updated. [ 1280.042668] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.042831] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1280.042872] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.043138] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1280.043280] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1280.051890] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 in Status: IN_PROGRESS for 2s [ 1282.063534] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 in Status: SUCCESS [ 1282.063893] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2764c19d-142c-47d2-aaf7-5c0e20ed83f2 deletion is rescheduled due to dependency. [ 1282.063893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2764c19d-142c-47d2-aaf7-5c0e20ed83f2" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.511107] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.511422] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1284.919857] env[62909]: INFO networking_nsxv3.common.synchronization [None req-9341f9a5-efd7-4f7b-8a73-2204e207c80a tempest-AttachVolumeTestJSON-255914310 tempest-AttachVolumeTestJSON-255914310-project-member] Enqueued Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_rules [ 1284.920399] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_rules [ 1284.920710] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.921089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.921089] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.921171] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.921238] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6f38d4f-9666-4ceb-abe5-ef323ac514fc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.991883] env[62909]: INFO networking_nsxv3.common.synchronization [None req-73303e16-b77c-4c7f-884b-9c8f4da480f4 tempest-AttachVolumeTestJSON-255914310 tempest-AttachVolumeTestJSON-255914310-project-member] Enqueued Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_rules [ 1284.992388] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_rules [ 1284.992771] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.992893] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1285.442073] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.442231] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1285.442315] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.442517] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1285.442617] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1285.442715] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc already deleted. [ 1285.442798] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1285.442948] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.443168] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1285.443261] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6f38d4f-9666-4ceb-abe5-ef323ac514fc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.965068] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.965527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1285.965527] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.965605] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1285.965672] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1285.965737] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc already deleted. [ 1285.965805] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.993258] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.993491] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.502032] env[62909]: INFO networking_nsxv3.common.synchronization [req-0704351d-0f1f-4e7b-839f-cfdd330e7500 req-ff8c1d33-cb07-4d94-b31c-9f3bf850dca1 tempest-AttachVolumeTestJSON-255914310 tempest-AttachVolumeTestJSON-255914310-project-member] Enqueued Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_members [ 1290.502279] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_members [ 1290.502735] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.502880] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.502976] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.503296] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.503451] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.503604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.503604] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.503850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.503850] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.503955] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6f38d4f-9666-4ceb-abe5-ef323ac514fc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.800540] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-966 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.800540] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-966" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.800540] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-966" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.800540] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-966" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.800540] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.800540] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.800540] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.800540] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.800943] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.800943] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1290.801020] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1290.801210] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1290.801365] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1290.801519] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1290.801656] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1290.801816] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1290.822619] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1290.822804] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1290.823007] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1290.823248] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-966" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.823630] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-b5f7a871-c81e-497e-9960-b3b7d7981318 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.823846] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-b5f7a871-c81e-497e-9960-b3b7d7981318" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.824023] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-b5f7a871-c81e-497e-9960-b3b7d7981318" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.824388] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-b5f7a871-c81e-497e-9960-b3b7d7981318" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.824567] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5f7a871-c81e-497e-9960-b3b7d7981318',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.005956] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.006398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1291.006398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.006398] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1291.006515] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1291.006656] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.006766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1291.006823] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.006951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1291.007046] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1291.007133] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc already deleted. [ 1291.007213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1291.326590] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.326801] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1291.326927] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.327232] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1291.327385] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1291.327584] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port b5f7a871-c81e-497e-9960-b3b7d7981318 not found, creating... [ 1291.327855] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.328026] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1291.328158] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.328386] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1291.328532] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1291.328812] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.328961] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1291.329092] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.329297] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1291.329437] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1291.329576] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: b5f7a871-c81e-497e-9960-b3b7d7981318 is going to be created. [ 1291.349376] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.349596] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1291.349706] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.349975] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1291.350230] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1291.350452] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-b5f7a871-c81e-497e-9960-b3b7d7981318" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1292.474979] env[62909]: INFO networking_nsxv3.common.synchronization [req-f2ab9677-0e5b-4998-98d6-af026b098afa req-86731573-9f68-4583-859c-88ad48e9f849 tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1292.475553] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1292.475905] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.476044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1292.476125] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.476359] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1292.476643] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.476643] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1292.476753] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.476834] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1292.476920] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1292.477025] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.690173] env[62909]: INFO networking_nsxv3.common.synchronization [req-0704351d-0f1f-4e7b-839f-cfdd330e7500 req-5c723407-bc1b-4a7a-a17c-64b4e8db717d service nova] Enqueued Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_rules [ 1292.690385] env[62909]: INFO networking_nsxv3.common.synchronization [req-0704351d-0f1f-4e7b-839f-cfdd330e7500 req-5c723407-bc1b-4a7a-a17c-64b4e8db717d service nova] Enqueued Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_members [ 1292.690547] env[62909]: INFO networking_nsxv3.common.synchronization [req-0704351d-0f1f-4e7b-839f-cfdd330e7500 req-5c723407-bc1b-4a7a-a17c-64b4e8db717d service nova] Enqueued Resource ID: b5f7a871-c81e-497e-9960-b3b7d7981318 with Priority: HIGHEST for action port [ 1292.690776] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_rules [ 1292.690903] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_members [ 1292.690996] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5f7a871-c81e-497e-9960-b3b7d7981318 with Priority: HIGHEST for action port [ 1292.691548] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.691673] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1292.691741] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.691945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1292.692040] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6f38d4f-9666-4ceb-abe5-ef323ac514fc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.693698] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.693698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1292.693698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.693698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1292.693698] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.693964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1292.693964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.693964] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1292.694074] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1292.694199] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6f38d4f-9666-4ceb-abe5-ef323ac514fc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.694889] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5f7a871-c81e-497e-9960-b3b7d7981318 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.694999] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5f7a871-c81e-497e-9960-b3b7d7981318" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1292.695079] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5f7a871-c81e-497e-9960-b3b7d7981318" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.695330] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5f7a871-c81e-497e-9960-b3b7d7981318" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1292.695450] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5f7a871-c81e-497e-9960-b3b7d7981318',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.979163] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.979388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1292.979388] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.979557] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1292.979651] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1292.979860] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.979942] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1292.980018] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.980172] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1292.980248] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1292.980333] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1293.008295] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.008524] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.008637] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.008945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.009180] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.018099] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1293.196638] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6f38d4f-9666-4ceb-abe5-ef323ac514fc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.197742] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.197854] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.198019] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5f7a871-c81e-497e-9960-b3b7d7981318 with status ACTIVE [ 1293.198201] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.198308] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.198364] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.198561] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.198646] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.198832] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.198925] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.198984] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.199153] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.199225] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.199402] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.199490] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.199596] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.199711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.199745] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.199808] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5f7a871-c81e-497e-9960-b3b7d7981318 is going to be updated. [ 1293.251372] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.251665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1293.251665] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.251790] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1293.252414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.252414] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5f7a871-c81e-497e-9960-b3b7d7981318" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1293.702412] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6f38d4f-9666-4ceb-abe5-ef323ac514fc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.204559] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.204792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1294.204792] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.205011] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1294.205116] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1294.205442] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc is going to be created. [ 1294.229768] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.229990] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1294.229990] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.230338] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1294.230442] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1294.239050] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc in Status: UNINITIALIZED for 2s [ 1295.029874] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1295.030275] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 deletion is rescheduled due to dependency. [ 1295.030275] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1296.249140] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc in Status: SUCCESS [ 1296.249523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1296.249523] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.249676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1296.249865] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.249978] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1296.250056] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.250210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1296.250291] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1296.250375] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1296.250465] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6f38d4f-9666-4ceb-abe5-ef323ac514fc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.752404] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6f38d4f-9666-4ceb-abe5-ef323ac514fc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.255423] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6f38d4f-9666-4ceb-abe5-ef323ac514fc: rpc.has_security_group_logging(os_id): False [ 1297.287076] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.287294] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1297.287294] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.287547] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1297.287698] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1297.287981] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.288099] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1297.288210] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.288395] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1297.288491] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1297.288601] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc is going to be created. [ 1297.374393] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.374660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1297.374660] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.374945] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1297.375158] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1297.388972] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc in Status: IN_PROGRESS for 2s [ 1297.691901] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1297.692066] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1299.401600] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc in Status: SUCCESS [ 1299.401963] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.077986] env[62909]: INFO networking_nsxv3.common.synchronization [req-788ee526-28cf-4f5e-9cd9-cc68b3580a3f req-f9d2c36c-a7d6-4e7b-ba86-a22b261e3a42 tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1300.078518] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1300.078820] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.080516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.080516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.080516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.080516] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.080516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.080516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.080516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.080516] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.080516] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.412576] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock network-96 taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.412908] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.412908] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.413229] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.413496] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.413658] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.413778] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.414008] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.414159] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.414413] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1300.414558] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] NeedRegenerationException {{(pid=62909) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1300.414675] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] no value, waiting for create lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1300.414785] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] value creation lock acquired {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1300.414902] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] No value present for key: 'zone-id' {{(pid=62909) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1300.415014] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Calling creation function for not-yet-present value {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1300.415155] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1300.433668] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1300.433856] env[62909]: DEBUG dogpile.cache.region [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62909) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1300.433964] env[62909]: DEBUG dogpile.lock [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Released creation lock {{(pid=62909) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1300.434156] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "network-96" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.434465] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock port-33aba8b9-6e20-4d5c-9d40-5ce1885662fe taken with stack trace [, , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.434643] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "port-33aba8b9-6e20-4d5c-9d40-5ce1885662fe" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.434766] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "port-33aba8b9-6e20-4d5c-9d40-5ce1885662fe" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.435118] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "port-33aba8b9-6e20-4d5c-9d40-5ce1885662fe" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.435300] env[62909]: DEBUG networking_nsxv3.api.rpc [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33aba8b9-6e20-4d5c-9d40-5ce1885662fe',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.583785] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.584044] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.584113] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.584311] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.584427] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.584638] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.584737] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.584800] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.584951] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.585040] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.585128] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1300.611052] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.611052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.611052] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.611326] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.611406] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.620248] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1300.937424] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.937675] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.937808] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.938130] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.938292] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.938474] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Segment Port 33aba8b9-6e20-4d5c-9d40-5ce1885662fe not found, creating... [ 1300.938739] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.938900] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.939036] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.939303] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.939455] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.939744] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.939902] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.940036] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.940251] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.940400] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.940548] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Resource: SegmentPort with ID: 33aba8b9-6e20-4d5c-9d40-5ce1885662fe is going to be created. [ 1300.966591] env[62909]: DEBUG networking_nsxv3.common.locking [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.966888] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1300.966965] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.967209] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1300.967440] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1300.967751] env[62909]: DEBUG oslo_concurrency.lockutils [None req-175d5446-bd76-45de-bf85-d69d26fa1795 None None] Releasing lock "port-33aba8b9-6e20-4d5c-9d40-5ce1885662fe" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1301.696107] env[62909]: INFO networking_nsxv3.common.synchronization [req-788ee526-28cf-4f5e-9cd9-cc68b3580a3f req-e5b9966d-ddd8-4584-91c0-e46bc01c6da1 service nova] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_rules [ 1301.696539] env[62909]: INFO networking_nsxv3.common.synchronization [req-788ee526-28cf-4f5e-9cd9-cc68b3580a3f req-e5b9966d-ddd8-4584-91c0-e46bc01c6da1 service nova] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1301.696680] env[62909]: INFO networking_nsxv3.common.synchronization [req-788ee526-28cf-4f5e-9cd9-cc68b3580a3f req-e5b9966d-ddd8-4584-91c0-e46bc01c6da1 service nova] Enqueued Resource ID: 33aba8b9-6e20-4d5c-9d40-5ce1885662fe with Priority: HIGHEST for action port [ 1301.697140] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_rules [ 1301.697287] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1301.697389] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33aba8b9-6e20-4d5c-9d40-5ce1885662fe with Priority: HIGHEST for action port [ 1301.697695] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.697890] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1301.697997] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.698349] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1301.698456] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.699732] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.699840] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1301.700124] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock port-33aba8b9-6e20-4d5c-9d40-5ce1885662fe taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.700245] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33aba8b9-6e20-4d5c-9d40-5ce1885662fe" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1301.700305] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33aba8b9-6e20-4d5c-9d40-5ce1885662fe" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.702343] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33aba8b9-6e20-4d5c-9d40-5ce1885662fe" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1301.702343] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33aba8b9-6e20-4d5c-9d40-5ce1885662fe',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.201973] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.202087] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.202313] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33aba8b9-6e20-4d5c-9d40-5ce1885662fe with status ACTIVE [ 1302.202491] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.202599] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.202664] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.202884] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.202971] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.203323] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.203495] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.203571] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.203772] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.203877] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.204124] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.204228] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.204293] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.204483] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.204579] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.204698] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33aba8b9-6e20-4d5c-9d40-5ce1885662fe is going to be updated. [ 1302.226009] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.226170] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.226213] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.226463] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.226607] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.226768] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33aba8b9-6e20-4d5c-9d40-5ce1885662fe" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.631015] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1302.631015] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 deletion is rescheduled due to dependency. [ 1302.631015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.631015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.631015] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.631350] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.631350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.631350] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.631474] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.631525] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.631619] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.134529] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.637251] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.143902] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.144254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1304.144254] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.144367] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1304.144437] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1304.144537] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1304.173096] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.173096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1304.173096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.173096] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1304.173472] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1304.183766] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1306.196069] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1306.196069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1306.196069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.196069] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1306.196069] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.196676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1306.196676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.196676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1306.196676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1306.196676] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1306.196676] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.699084] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1306.699292] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1306.699460] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.202030] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ef8091d-5beb-460c-8d49-21cf9cd46551: rpc.has_security_group_logging(os_id): False [ 1307.223079] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.223335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.223335] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.223539] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.223628] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1307.223874] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.223972] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.224043] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.224199] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.224273] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1307.224357] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1307.283934] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.284124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.284124] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.284303] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.284448] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1307.295791] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1307.829809] env[62909]: INFO networking_nsxv3.common.synchronization [req-fc5ccc01-ebaf-4224-98e5-66200d66a5f1 req-14601955-f6e1-4a47-af82-4bd6a7e2ffe4 tempest-AttachVolumeNegativeTest-515169220 tempest-AttachVolumeNegativeTest-515169220-project-member] Enqueued Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_members [ 1307.830587] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 with Priority: HIGHEST for action security_group_members [ 1307.831468] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-739e20a9-7c77-4c75-bf12-2cffdc2cea28 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.831468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.831468] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.831656] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.832033] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.832033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.832033] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.832386] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.832452] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1307.832612] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('739e20a9-7c77-4c75-bf12-2cffdc2cea28',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.334652] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.335128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.335128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.335128] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.356711] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.356972] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.357114] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.357169] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.357360] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.357443] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.357534] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 is going to be updated. [ 1308.382681] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.382929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.382929] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.383054] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.383202] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.392485] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 in Status: IN_PROGRESS for 2s [ 1309.312676] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1309.312934] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.401796] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 in Status: SUCCESS [ 1310.402197] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739e20a9-7c77-4c75-bf12-2cffdc2cea28 deletion is rescheduled due to dependency. [ 1310.402197] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739e20a9-7c77-4c75-bf12-2cffdc2cea28" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1312.831975] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.832353] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1317.833625] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1317.834045] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.834489] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.834861] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.835338] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.835338] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.836897] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1332.837291] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1337.838759] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1337.839188] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.840244] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.840574] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1347.842161] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.842579] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1352.843716] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1352.844180] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.845821] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.845821] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1362.846788] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.847202] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1363.345212] env[62909]: INFO networking_nsxv3.common.synchronization [req-2e64335d-4b7d-4346-9209-9bd5ccb95cac req-aa50c468-2977-4413-957c-fb8f89787e9e tempest-ServerActionsTestJSON-1910611028 tempest-ServerActionsTestJSON-1910611028-project-member] Enqueued Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1363.345833] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 with Priority: HIGHEST for action security_group_members [ 1363.346630] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef8091d-5beb-460c-8d49-21cf9cd46551 taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.346630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1363.346630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.346630] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1363.346630] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.346932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1363.346932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.346932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1363.346932] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1363.347114] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef8091d-5beb-460c-8d49-21cf9cd46551',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.849634] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.850070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1363.850070] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.850454] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1363.850663] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1363.850919] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.851064] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1363.851189] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.851405] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1363.851551] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1363.851696] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 is going to be updated. [ 1363.893967] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.894241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1363.894241] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.894376] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1363.894616] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1363.903994] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: IN_PROGRESS for 2s [ 1365.916060] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 in Status: SUCCESS [ 1365.916373] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef8091d-5beb-460c-8d49-21cf9cd46551 deletion is rescheduled due to dependency. [ 1365.916373] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef8091d-5beb-460c-8d49-21cf9cd46551" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1368.347292] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.347292] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.174540] env[62909]: INFO networking_nsxv3.common.synchronization [req-a722fd95-f6ff-4887-89cf-612e524d5eb5 req-f7ffddcd-cde5-49ab-bf90-de973da3469f tempest-AttachVolumeTestJSON-255914310 tempest-AttachVolumeTestJSON-255914310-project-member] Enqueued Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_members [ 1369.175067] env[62909]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc with Priority: HIGHEST for action security_group_members [ 1369.175383] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc taken with stack trace [, , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.175505] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1369.175573] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.175766] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1369.175922] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.176050] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1369.176127] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.176286] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1369.176369] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1369.176461] env[62909]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6f38d4f-9666-4ceb-abe5-ef323ac514fc',) {} {{(pid=62909) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.679063] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.679494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1369.679494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.679494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1369.679494] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1369.679694] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.679788] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1369.679849] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.679996] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1369.680091] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1369.680178] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc is going to be updated. [ 1369.708499] env[62909]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62909) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.708735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1369.708735] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.708896] env[62909]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1369.709049] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1369.717399] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc in Status: IN_PROGRESS for 2s [ 1371.728220] env[62909]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc in Status: SUCCESS [ 1371.728626] env[62909]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6f38d4f-9666-4ceb-abe5-ef323ac514fc deletion is rescheduled due to dependency. [ 1371.728626] env[62909]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6f38d4f-9666-4ceb-abe5-ef323ac514fc" {{(pid=62909) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1374.176358] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.176748] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.177570] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.178025] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.178504] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.178867] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.179635] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.180090] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.180741] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.181035] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.181804] env[62909]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1399.182168] env[62909]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0